-- Logs begin at Thu 2022-09-01 13:01:25 UTC, end at Thu 2022-09-01 14:19:24 UTC. -- Sep 01 13:45:15.849557 dv-cinder-839768-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 13:45:15.858664 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:45:15 2022] *** Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: nodename: dv-cinder-839768-5-iscsi Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: machine: x86_64 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: clock source: unix Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: pcre jit disabled Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: detected number of CPU cores: 4 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: current working directory: / Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: your processes number limit is 47680 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: your memory page size is 4096 bytes Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: detected max file descriptor number: 2048 Sep 01 13:45:15.861049 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: lock engine: pthread robust mutexes Sep 01 13:45:15.862414 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: thunder lock: enabled Sep 01 13:45:15.862414 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 13:45:15.862414 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:45:15.901717 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: Python main interpreter initialized at 0x56496b4b39c0 Sep 01 13:45:15.901717 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: python threads support enabled Sep 01 13:45:15.901717 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: your server socket listen backlog is limited to 100 connections Sep 01 13:45:15.901717 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:45:15.902100 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:45:15.902167 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: *** Operational MODE: preforking *** Sep 01 13:45:15.902600 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:45:15.902600 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: spawned uWSGI master process (pid: 112676) Sep 01 13:45:15.902718 dv-cinder-839768-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 13:45:15.907395 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: spawned uWSGI worker 1 (pid: 112677, cores: 1) Sep 01 13:45:15.907395 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: spawned uWSGI worker 2 (pid: 112678, cores: 1) Sep 01 13:45:15.907395 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:45:16.566330 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:45:16.567859 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:45:17.658372 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:45:17.658372 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: from cryptography.utils import int_from_bytes Sep 01 13:45:17.659074 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:45:17.659074 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: from cryptography.utils import int_from_bytes Sep 01 13:45:17.659768 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:45:17.659768 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: from cryptography.utils import int_from_bytes Sep 01 13:45:17.660210 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:45:17.660210 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: from cryptography.utils import int_from_bytes Sep 01 13:45:20.162814 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:45:20.163371 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:45:20.163526 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:45:20.163894 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:45:20.164153 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:45:20.164545 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.164920 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.165245 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.165568 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.165901 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.166212 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.166535 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.166856 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.167184 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.167465 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.167783 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.168109 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-5-iscsi {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.168431 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.168738 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.168981 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:45:20.169362 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.169454 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:45:20.169542 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.169643 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.169736 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:45:20.169962 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.170095 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:45:20.170277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.170365 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:45:20.170777 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.170895 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171102 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171200 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171441 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171542 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171760 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.171848 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172086 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172276 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172395 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172697 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.172793 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173012 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173117 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173337 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173427 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173594 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173682 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.173992 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.174253 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-5-iscsi {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.174556 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-5-iscsi {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.174654 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.174863 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.174949 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175166 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175255 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175503 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175607 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175802 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.175939 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.176119 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.176254 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.176420 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.176548 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.176842 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.177046 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.177268 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.177475 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.177693 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.177898 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178041 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178167 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178291 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178443 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178571 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178705 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.178843 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179007 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179150 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179277 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179445 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179584 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179717 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.179866 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180004 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180131 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180263 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180400 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-5-iscsi {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180535 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180660 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180785 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.180909 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181043 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181220 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181584 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181721 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.181904 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182048 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182208 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182462 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182593 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182771 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.182913 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183089 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183415 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183550 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183723 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.183855 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184025 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184147 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184329 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184458 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184631 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184763 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.184929 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185055 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185228 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185361 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185530 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185659 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185825 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.185961 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186120 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186248 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186381 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186506 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186651 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186779 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.186966 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187095 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187278 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187441 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187698 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187840 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.187978 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188115 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188248 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188375 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188501 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188625 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188758 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.188935 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.189064 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.189252 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.189374 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190091 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190231 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190392 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190520 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190690 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190819 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.190987 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191126 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191285 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191454 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191593 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191726 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.191906 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192046 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192195 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192323 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192494 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192624 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192796 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.192938 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193103 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193238 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193404 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193530 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193735 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.193871 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194004 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194138 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194264 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194389 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194695 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194867 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.194996 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195169 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195299 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195522 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195655 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195813 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.195943 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196115 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196246 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196419 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196549 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196723 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.196851 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197024 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197162 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197324 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197454 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197586 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197710 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.197922 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198065 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198192 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198325 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198452 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198584 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198747 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.198885 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199046 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199175 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199348 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199513 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199679 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199818 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.199981 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200110 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200280 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200415 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200578 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200717 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.200876 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201004 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201173 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201308 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201470 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201610 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201769 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.201905 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202068 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202198 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202365 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202494 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202660 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202796 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.202972 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203101 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203274 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203437 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203593 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203720 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.203891 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204018 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204185 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204323 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204483 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204611 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204781 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.204909 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.205081 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.205209 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.205432 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206091 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206259 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206395 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206560 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206698 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206860 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.206990 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207173 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207302 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207492 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207628 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207789 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.207937 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.208103 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.208240 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.208397 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.208534 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.208698 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.208829 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.209009 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.209148 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.209308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.209437 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.209607 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.209744 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.209904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.210043 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.210200 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.210330 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.210502 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.210653 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.210818 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.210951 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.211114 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.211250 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.211433 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.211564 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.211711 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.211871 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.212028 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.212164 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.212342 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.212471 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.212644 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.212767 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.212943 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.213098 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.213234 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.213414 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.213553 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:45:20.213727 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.213867 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214043 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214172 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214488 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214666 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214795 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.214991 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215120 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215309 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215557 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215687 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215812 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.215969 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216099 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216444 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216748 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.216945 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217130 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217268 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217404 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217571 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217701 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.217882 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218001 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218188 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218319 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218510 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218637 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218819 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.218955 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219128 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219257 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219461 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219592 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219766 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.219910 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220077 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220207 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220388 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220524 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220697 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.220832 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221031 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221165 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221344 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221474 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221656 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221797 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.221992 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222129 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222324 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222459 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222651 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222789 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.222966 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223095 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223470 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223767 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.223931 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224059 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224241 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224370 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224545 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224674 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224846 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.224973 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225148 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225278 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225450 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225584 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225758 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.225887 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226060 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226188 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226363 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226498 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226671 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226807 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.226977 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227114 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227307 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227469 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227638 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227775 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.227954 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228081 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228264 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228396 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228569 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228705 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.228881 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229019 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229185 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229314 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229488 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229625 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229790 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.229928 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230089 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230216 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230387 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230516 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230684 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230831 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.230974 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231092 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231272 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231461 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231611 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231754 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.231922 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232052 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232222 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232349 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232528 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232665 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232832 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.232952 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233137 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233274 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233441 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233574 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233752 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.233881 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.234295 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.234428 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.234608 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.234737 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.234913 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235043 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235211 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235349 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235552 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235683 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235856 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.235985 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236158 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236295 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236500 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236630 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236801 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.236931 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237102 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237240 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237406 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237537 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237707 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.237836 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238109 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238312 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238441 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238566 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238691 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238824 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.238949 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239082 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239208 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239334 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239496 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239624 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239789 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.239920 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240097 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240227 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240399 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240528 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240701 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.240831 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241001 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241130 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241348 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241486 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241652 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241782 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.241964 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242091 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242261 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242391 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242560 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242690 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242856 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.242984 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243160 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243413 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243545 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243671 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243796 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.243919 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244043 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244185 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244336 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244466 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244632 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244761 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.244948 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245085 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245277 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245414 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245577 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245706 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.245876 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246014 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246174 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246303 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246512 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246651 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246812 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.246943 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247127 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247255 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247464 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247596 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247798 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.247927 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248116 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248246 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248422 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248559 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248731 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.248862 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249035 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249164 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249341 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249471 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249645 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249774 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.249938 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250066 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250242 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250371 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250546 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250674 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250857 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.250987 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251159 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251289 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251499 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251629 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251804 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.251936 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.252625 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.252769 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.252911 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253120 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253250 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253375 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253541 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253680 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253850 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.253979 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254166 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254294 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254483 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254621 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254788 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.254925 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255095 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255230 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255424 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255553 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255714 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.255843 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256017 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256147 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256341 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256474 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256643 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256772 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.256946 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257077 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257254 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257385 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257558 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257693 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257863 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.257990 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258164 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258293 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258463 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258584 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258760 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.258898 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259066 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259205 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259425 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259558 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259695 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259837 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.259987 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260117 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260299 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260426 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260605 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260747 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.260908 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261036 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261210 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261513 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261655 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261810 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.261939 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262107 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262236 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262421 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262557 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262723 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.262851 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263025 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263155 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263481 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263665 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263795 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.263976 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264105 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264279 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264410 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264576 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264704 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.264873 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265002 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265176 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265306 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265491 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265627 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265793 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.265921 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266099 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266228 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266415 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266543 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266714 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.266852 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267013 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267143 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267321 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267490 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267672 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.267813 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.268591 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.268734 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269073 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269185 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269407 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269530 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269729 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269839 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.269957 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270215 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270451 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270559 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270667 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270840 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.270959 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271127 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271408 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271408 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271617 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271817 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.271992 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272312 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272457 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272593 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272721 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.272848 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273102 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273102 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273407 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273550 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273677 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273803 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.273975 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274155 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274325 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274496 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274627 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274752 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.274930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275118 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275244 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275352 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275562 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275709 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.275852 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276025 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276161 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276340 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276474 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276474 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276731 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276857 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.276985 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277110 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277290 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277418 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277553 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277729 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.277856 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278033 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278179 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278307 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278480 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278622 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278756 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.278920 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279051 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279179 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279350 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279513 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279681 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279819 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.279953 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280122 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280258 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280394 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280572 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280701 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280827 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.280951 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281092 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281229 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281407 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281538 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281665 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281833 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.281976 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282132 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282258 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282429 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282564 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282728 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.282877 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283035 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283165 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283380 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283507 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283680 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283820 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.283980 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284109 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284286 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284416 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284586 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284715 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.284883 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285011 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285187 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285324 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285494 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285632 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285801 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.285939 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286107 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286246 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286408 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286552 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286713 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.286844 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287012 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287151 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287324 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287523 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287667 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287795 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.287942 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288085 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288244 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288374 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288549 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288679 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288845 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.288987 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289142 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289270 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289441 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289570 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289736 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.289874 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290039 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290177 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290337 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290638 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290769 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.290961 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291098 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291282 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291417 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291610 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291742 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.291906 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292037 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292215 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292517 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292648 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292816 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.292931 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293112 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293241 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293414 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293552 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293714 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.293856 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294008 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294135 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294438 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294604 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294734 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.294912 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295049 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295209 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295338 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295527 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295668 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.295824 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296032 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296161 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296286 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296410 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296535 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296706 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.296845 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297008 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297138 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297311 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297448 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297611 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297749 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.297914 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298045 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298214 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298344 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298510 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298646 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298807 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.298944 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299133 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299263 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299460 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299591 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299763 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.299894 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300057 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300194 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300360 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300490 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300657 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300787 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.300954 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301093 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301252 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301368 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301555 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301685 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301852 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.301990 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302175 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302305 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302474 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302596 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302772 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.302910 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303068 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303206 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303399 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303534 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303707 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.303847 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304077 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304220 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304331 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304436 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304585 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304716 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.304921 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305044 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305219 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305353 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305536 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305673 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.305860 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.306057 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.306249 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.306445 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.306653 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.306851 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307029 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307167 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307295 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307453 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307596 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307724 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307849 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.307981 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308107 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308232 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308366 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308504 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308630 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308764 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.308899 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309034 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309168 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309302 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309428 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309554 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309679 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309813 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.309971 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310110 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310286 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310416 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310603 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310742 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.310921 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311051 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311219 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311349 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311681 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311816 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.311950 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312121 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312251 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312423 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312556 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312723 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.312854 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313024 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313153 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313325 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313456 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313628 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.313790 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.314042 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.314238 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.314408 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.314540 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315217 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315352 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315499 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315624 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315768 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.315898 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316031 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316158 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316283 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316504 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316636 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316813 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.316951 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317121 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317253 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317427 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317558 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317784 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.317928 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318084 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318215 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318355 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318482 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318615 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318741 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.318911 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319050 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319210 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319342 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319592 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319727 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.319904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320043 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320207 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320335 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320514 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320642 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320809 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.320952 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321218 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321349 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321519 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321648 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321821 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.321957 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322122 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322252 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322416 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322552 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322711 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.322853 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323013 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323144 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323328 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323488 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323651 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323788 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.323945 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324158 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324419 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324622 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324758 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.324937 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325081 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325210 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325544 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325675 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325845 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.325975 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326140 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326470 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326598 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326780 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.326912 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327100 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327230 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327470 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327601 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327790 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.327929 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328108 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328238 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328408 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328546 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328713 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.328843 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329015 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329153 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329322 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329461 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329629 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329759 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.329929 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.330066 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.330286 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.330923 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331099 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331230 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331430 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331566 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331742 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.331887 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332049 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332187 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332353 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332484 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332654 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332778 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.332955 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333086 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333278 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333428 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333564 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333694 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.333884 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334023 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334194 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334325 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334514 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334647 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334824 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.334954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335121 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335252 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335507 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335640 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335767 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.335893 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336027 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336162 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336320 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336450 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336638 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336768 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.336941 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337078 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337238 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337368 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337541 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337671 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337857 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.337988 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.338212 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.338468 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.338609 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.338744 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.338882 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339019 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339147 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339272 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339441 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339571 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339706 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339834 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.339961 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340094 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340257 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340387 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340554 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340685 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340852 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.340983 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341147 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341291 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341481 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341612 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341781 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.341911 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342083 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342212 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342383 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342510 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342683 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342814 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.342984 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343123 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343304 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343506 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343635 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343761 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.343938 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344081 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344246 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344371 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344548 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344686 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344848 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.344985 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345147 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345449 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345579 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345746 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.345909 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346067 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346199 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346365 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346504 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346666 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346807 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.346959 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.347084 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.347244 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.347397 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.347800 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348014 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348144 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348483 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348483 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348777 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.348904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.349030 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.349156 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.349290 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.349419 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.349709 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350016 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350148 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350283 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350485 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350657 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350785 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350911 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.350911 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351164 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351291 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351478 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351618 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351745 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351855 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.351994 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.352390 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.352390 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.352817 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353034 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353147 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353217 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353301 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353396 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353484 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353566 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353689 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353773 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.353958 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.354146 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.354271 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.354447 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.354599 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.354921 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355027 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355246 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355335 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355629 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355720 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.355948 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356045 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356258 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356360 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356567 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356655 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356875 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.356973 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357183 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357272 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357494 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357581 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357799 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.357889 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358106 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358246 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358415 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358620 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358709 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.358798 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.359022 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.359437 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.359626 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.359728 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.359942 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360030 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360251 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360338 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360557 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360654 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360864 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.360951 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361171 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361257 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361513 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361614 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361836 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.361987 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.362169 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.362416 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.362513 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.362784 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.362871 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.363101 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.363333 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.363469 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.363784 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.363960 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.364240 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.364380 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.364596 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.364763 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.364919 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.365121 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.365242 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.365547 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.365647 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.365929 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366017 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366256 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366434 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366562 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366865 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.366961 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.367172 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.367416 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.367527 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.367760 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.367858 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368080 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368170 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368391 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368486 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368691 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.368787 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369002 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369095 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369304 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369528 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369835 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.369937 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370164 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370257 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370483 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370603 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370863 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.370978 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371134 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371223 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371469 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371560 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371776 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.371864 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372087 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372181 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372388 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372484 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372689 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372784 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.372994 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373086 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373296 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373420 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373597 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373704 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.373900 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374049 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374197 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374286 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374502 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374624 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374807 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.374960 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.375110 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.375335 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.375490 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.375700 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.375937 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376097 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376266 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376395 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376523 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376659 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376787 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.376913 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.377552 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.377722 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.377855 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378026 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378157 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378331 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378462 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378634 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378767 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.378942 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379073 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379243 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379402 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379579 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379711 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.379879 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380015 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380184 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380323 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380484 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380613 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380784 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.380913 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381090 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381228 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381387 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381528 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381710 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381856 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.381991 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382131 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382295 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382464 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382640 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382769 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.382907 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383034 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383208 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383343 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383531 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383672 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383811 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.383947 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384074 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384200 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384380 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384679 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384821 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.384985 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385116 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385284 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385414 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385590 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385733 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.385888 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386030 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386240 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386369 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386540 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386671 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386859 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.386989 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387160 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387291 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387481 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387615 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387794 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.387923 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388102 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388231 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388417 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388550 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388721 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.388851 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389023 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389152 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389360 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389501 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389669 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389807 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.389975 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390207 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390340 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390540 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390670 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390854 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.390983 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391161 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391302 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391507 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391645 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391780 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.391908 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.392097 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.392227 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.392398 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.392529 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.392762 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.393431 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.393580 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.393707 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.393891 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394021 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394196 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394335 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394501 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394631 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394804 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.394933 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395110 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395322 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395496 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395623 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395748 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.395934 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396074 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396245 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396376 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396550 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396760 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.396902 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397072 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397203 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397391 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397521 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397711 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.397841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398019 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398149 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398341 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398472 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398656 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398794 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.398963 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399091 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399281 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399465 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399605 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399743 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.399930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400061 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400236 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400373 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400538 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400681 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400840 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.400970 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401148 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401467 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401604 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401772 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.401902 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402069 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402197 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402382 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402512 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402689 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402820 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.402989 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403127 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403289 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403439 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403684 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403825 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.403966 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404094 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404228 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404356 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404481 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404615 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404781 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.404923 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405088 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405218 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405434 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405584 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405712 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.405848 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406004 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406135 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406306 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406444 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406609 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406746 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.406910 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407043 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407216 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407346 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407526 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407658 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407831 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.407961 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408130 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408268 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408456 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408600 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408757 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.408888 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409089 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409218 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409386 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409524 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409685 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409824 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.409982 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410112 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410278 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410408 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410578 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410715 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.410875 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411013 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411194 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411333 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411485 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411612 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411781 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.411926 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412078 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412208 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412373 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412530 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412660 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.412888 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413027 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413154 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413288 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413445 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413575 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413758 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.413884 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414065 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414169 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414603 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414725 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414811 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.414939 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415033 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415115 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415300 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415433 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415625 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415714 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.415942 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416039 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416245 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416358 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416582 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416671 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.416897 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417105 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417220 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417429 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417526 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417804 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.417900 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.418109 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.418355 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.418451 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.418710 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.418896 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.419024 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.419332 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.419457 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.419664 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.419981 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.420081 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.420294 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.420552 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.420663 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.420929 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.421122 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.421237 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.421563 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.421977 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.422071 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.422384 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.422564 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.422799 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423066 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423163 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423412 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423505 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423757 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.423854 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.424113 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.424224 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.424415 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.424503 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.424659 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:45:20.424749 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.425055 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.425391 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.425705 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.426020 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.426327 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.426641 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.426986 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.427304 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.427642 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.427975 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.428507 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.428829 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.429159 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.429487 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.429797 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.430126 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.430453 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.430909 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.431776 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.432541 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.432882 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.433205 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.433586 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.433897 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:45:20.434142 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:45:20.581778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO dbcounter [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Registered counter for database nova_api Sep 01 13:45:20.592635 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO dbcounter [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Registered counter for database nova_api Sep 01 13:45:20.602922 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_db.sqlalchemy.engines [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.609916 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writer thread running {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.613525 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_db.sqlalchemy.engines [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.619962 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writer thread running {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.667958 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.context [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),faee2cfd-b53c-4fee-84f6-475fe826578e(cell1) {{(pid=112677) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:45:20.671760 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:45:20.672234 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:45:20.673785 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:45:20.674566 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:45:20.675006 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:45:20.677028 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:45:20.677488 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.context [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),faee2cfd-b53c-4fee-84f6-475fe826578e(cell1) {{(pid=112678) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:45:20.679016 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO dbcounter [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Registered counter for database nova_cell0 Sep 01 13:45:20.681545 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:45:20.682016 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:45:20.683031 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO dbcounter [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Registered counter for database nova_cell1 Sep 01 13:45:20.683643 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:45:20.684375 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:45:20.684811 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:45:20.686857 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_concurrency.lockutils [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:45:20.688902 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO dbcounter [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Registered counter for database nova_cell0 Sep 01 13:45:20.692166 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_db.sqlalchemy.engines [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.693277 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_db.sqlalchemy.engines [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.693391 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO dbcounter [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Registered counter for database nova_cell1 Sep 01 13:45:20.699191 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writer thread running {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.702418 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_db.sqlalchemy.engines [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.703191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_db.sqlalchemy.engines [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.704535 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writer thread running {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.711280 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writer thread running {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.712736 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writer thread running {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.848330 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO dbcounter [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Registered counter for database nova_cell0 Sep 01 13:45:20.855202 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_db.sqlalchemy.engines [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.859545 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO dbcounter [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Registered counter for database nova_cell0 Sep 01 13:45:20.859828 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writer thread running {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:20.868576 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG oslo_db.sqlalchemy.engines [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:45:20.873404 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writer thread running {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:45:21.272749 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: WARNING keystonemiddleware.auth_token [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:45:21.280142 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: WARNING keystonemiddleware.auth_token [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:45:21.298349 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: WARNING keystonemiddleware.auth_token [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:45:21.306234 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: WARNING keystonemiddleware.auth_token [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:45:21.621952 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: WARNING keystonemiddleware.auth_token [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:45:21.628706 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: WARNING keystonemiddleware.auth_token [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:45:21.633957 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56496b4b39c0 pid: 112677 (default app) Sep 01 13:45:21.636054 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:45:21.637289 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001820 Sep 01 13:45:21.637961 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Thu Sep 1 13:45:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:45:21.649045 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: WARNING keystonemiddleware.auth_token [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:45:21.655156 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: WARNING keystonemiddleware.auth_token [None req-517d744f-09b6-4440-9ee8-cd2a4fc1103d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:45:21.661143 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56496b4b39c0 pid: 112678 (default app) Sep 01 13:46:43.031004 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:43.032026 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 Sep 01 13:46:43.032410 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:43.044736 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_api:SELECT=3 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.045620 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_cell1:SELECT=3 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.046551 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_cell0:SELECT=3 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.047950 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.918845 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-db12ac4b-d2ab-43d9-b8fb-9358d0f3be85 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:43.951667 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-db12ac4b-d2ab-43d9-b8fb-9358d0f3be85 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912048 Sep 01 13:46:43.953559 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Thu Sep 1 13:46:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:46:46.311766 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:46.312773 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-b2044fab-9645-4edc-a3db-7df294da3087 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 01 13:46:46.313611 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:46.793444 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-9352d352-eb62-4635-95cc-1e2f82ce8535 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:46.948041 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-9352d352-eb62-4635-95cc-1e2f82ce8535 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.627882 Sep 01 13:46:46.948727 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:46:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:47.178438 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-ae09992a-17ae-4a4d-8bfa-1bbba8fe2024 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:47.185022 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_api:SELECT=3 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:47.186457 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_cell0:SELECT=3 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:47.187520 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_cell1:SELECT=3 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:47.188226 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:47.322805 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-ae09992a-17ae-4a4d-8bfa-1bbba8fe2024 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364709 Sep 01 13:46:47.326946 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Thu Sep 1 13:46:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:46:49.695552 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-9352d352-eb62-4635-95cc-1e2f82ce8535 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:49.696712 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-9352d352-eb62-4635-95cc-1e2f82ce8535 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 01 13:46:49.697146 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:50.366468 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-a9da3786-fb9c-4eae-a997-2f08548a54cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:50.500816 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-a9da3786-fb9c-4eae-a997-2f08548a54cd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.797062 Sep 01 13:46:50.502748 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:46:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:46:50.514702 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-5d90e97d-8ed3-4311-a452-c9d7a79b21ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:50.650785 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-5d90e97d-8ed3-4311-a452-c9d7a79b21ac admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140484 Sep 01 13:46:50.660104 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Thu Sep 1 13:46:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:46:53.009177 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-a9da3786-fb9c-4eae-a997-2f08548a54cd admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:53.010206 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-a9da3786-fb9c-4eae-a997-2f08548a54cd admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 01 13:46:53.010631 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:53.418232 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-86b417b4-f728-4156-8799-502438ffb354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:53.491628 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-86b417b4-f728-4156-8799-502438ffb354 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474119 Sep 01 13:46:53.492232 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:46:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:53.504978 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e4b50362-2d85-48df-a7c1-682ae49de22f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:53.603925 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-e4b50362-2d85-48df-a7c1-682ae49de22f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102590 Sep 01 13:46:53.604571 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Thu Sep 1 13:46:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:46:56.009351 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-86b417b4-f728-4156-8799-502438ffb354 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:56.010374 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-86b417b4-f728-4156-8799-502438ffb354 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 01 13:46:56.011147 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:56.447083 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-6ee8fd1a-c72e-44f3-92ce-1ce465b044d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "swap": 0, "ram": 2048, "disk": 10}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:56.542928 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-6ee8fd1a-c72e-44f3-92ce-1ce465b044d0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525618 Sep 01 13:46:56.543993 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:46:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:56.556357 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-45dd1e87-c3ae-4c3e-a575-23771cfbe26b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:56.661433 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-45dd1e87-c3ae-4c3e-a575-23771cfbe26b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108621 Sep 01 13:46:56.662259 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Thu Sep 1 13:46:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:46:59.059511 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-6ee8fd1a-c72e-44f3-92ce-1ce465b044d0 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:46:59.060591 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-6ee8fd1a-c72e-44f3-92ce-1ce465b044d0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Sep 01 13:46:59.061176 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:46:59.491228 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:59.571000 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503520 Sep 01 13:46:59.571588 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:46:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:59.583406 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-110ca90b-0fc2-41ed-b467-e1c03b4374cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:46:59.747124 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-110ca90b-0fc2-41ed-b467-e1c03b4374cc admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.167293 Sep 01 13:46:59.748478 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Thu Sep 1 13:46:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:47:02.508748 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:02.509804 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Sep 01 13:47:02.510320 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:02.955392 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-44731837-f0f0-4215-91a6-899322aa7803 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:02.980236 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-44731837-f0f0-4215-91a6-899322aa7803 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462595 Sep 01 13:47:02.980771 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Thu Sep 1 13:47:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:05.826890 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:05.827969 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-3d959262-39c2-4d0a-83b9-c46389d03db5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 01 13:47:05.828355 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:47:06.226017 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e96cb860-955d-4213-b0e9-410b3b2d0bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "ram": 512}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:06.319654 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-e96cb860-955d-4213-b0e9-410b3b2d0bfe admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485038 Sep 01 13:47:06.320292 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:47:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:06.332027 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-5ebac48b-b6c3-4628-b249-c4dbc9f28221 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:06.421615 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-5ebac48b-b6c3-4628-b249-c4dbc9f28221 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093023 Sep 01 13:47:06.422099 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Thu Sep 1 13:47:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:47:08.746221 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e96cb860-955d-4213-b0e9-410b3b2d0bfe admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:08.748397 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-e96cb860-955d-4213-b0e9-410b3b2d0bfe admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 01 13:47:08.748397 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:09.116085 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-f254e6d3-9204-4e81-9f6b-e35f4ef08c02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:09.216802 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-f254e6d3-9204-4e81-9f6b-e35f4ef08c02 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462306 Sep 01 13:47:09.217387 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:47:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:09.229461 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-545a8c2d-3923-4b1f-a92c-4a94210a8526 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:09.381260 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-545a8c2d-3923-4b1f-a92c-4a94210a8526 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155334 Sep 01 13:47:09.382061 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Thu Sep 1 13:47:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:47:11.794747 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-f254e6d3-9204-4e81-9f6b-e35f4ef08c02 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:11.795792 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-f254e6d3-9204-4e81-9f6b-e35f4ef08c02 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 01 13:47:11.796190 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:12.310511 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-fd706a45-b762-483a-a4a1-d554dc175b77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:12.976620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-fd706a45-b762-483a-a4a1-d554dc175b77 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.174290 Sep 01 13:47:12.977199 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:47:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:47:12.989969 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-681d6888-e826-47de-ba2c-8f1b032cee07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:13.112695 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-681d6888-e826-47de-ba2c-8f1b032cee07 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126122 Sep 01 13:47:13.113223 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Thu Sep 1 13:47:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:47:15.503453 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-fd706a45-b762-483a-a4a1-d554dc175b77 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:15.505125 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-fd706a45-b762-483a-a4a1-d554dc175b77 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Sep 01 13:47:15.505683 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:15.947901 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-a623f982-ee43-43c3-860e-3171984e01e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "id": "4", "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:15.955937 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:16.056548 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-a623f982-ee43-43c3-860e-3171984e01e1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544723 Sep 01 13:47:16.057737 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:47:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:16.070377 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-8096f4c9-61f5-45dd-bfb6-1b967da8bb1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:16.152133 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-8096f4c9-61f5-45dd-bfb6-1b967da8bb1f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085597 Sep 01 13:47:16.153286 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Thu Sep 1 13:47:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:47:18.593231 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-a623f982-ee43-43c3-860e-3171984e01e1 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:18.595048 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-a623f982-ee43-43c3-860e-3171984e01e1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Sep 01 13:47:18.595774 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:19.069056 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:19.075345 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:19.216927 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.615106 Sep 01 13:47:19.217833 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Thu Sep 1 13:47:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:19.232123 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-c57815fd-18cc-4aa9-937f-f32371389d15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:19.329973 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-c57815fd-18cc-4aa9-937f-f32371389d15 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103929 Sep 01 13:47:19.330726 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Thu Sep 1 13:47:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:47:37.758954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:37.759921 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 01 13:47:37.760322 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:47:38.149966 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-bddf5c4b-831d-4111-9791-3c22c1a07a71 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:38.170655 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-bddf5c4b-831d-4111-9791-3c22c1a07a71 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403691 Sep 01 13:47:38.171186 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Thu Sep 1 13:47:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:39.222831 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:39.223873 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-65367a04-cde6-46ce-945e-a1cd55a7aa6d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 01 13:47:39.224299 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:39.755397 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-830f855a-a632-4bd0-8949-6bcdaa1d0564 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:39.761028 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.wsgi [None req-830f855a-a632-4bd0-8949-6bcdaa1d0564 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-830f855a-a632-4bd0-8949-6bcdaa1d0564 admin admin] Request method failure captured: Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept: application/json Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept-Encoding: gzip, deflate Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Connection: keep-alive Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Content-Length: 0 Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Host: 10.222.0.50 Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-System-Scope: None Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: User-Agent: python-novaclient Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Auth-Token: gAAAAABjELf7hXFr4agamZ5WfPdrD3xi86FmAb1Pr0KWAuZ8NDxLcpeCfaqW3rcRN-3t2mAGXzp9ETxVLx_SCsEY2ue6sbZV18Bhb8lBUC38z_xtaL6VPtZmvxSpVK1wfAFUa7RmpLuZTqJFm7jii-6zf6ICF1kanmiws8fDcW0VxJZ_xpoF9IU Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Id: None Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Name: None Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Identity-Status: Confirmed Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Is-Admin-Project: True Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Id: default Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Name: Default Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Name: admin Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Role: reader,admin,member Sep 01 13:47:39.764308 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Roles: reader,admin,member Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant: admin Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Name: admin Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User: admin Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Id: default Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Name: Default Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Name: admin Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: method: > Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: exception: Flavor 42 could not be found. Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: action_args: {'id': '42'} Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:39.766191 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:39.767293 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.768841 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-830f855a-a632-4bd0-8949-6bcdaa1d0564 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:39.770105 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-830f855a-a632-4bd0-8949-6bcdaa1d0564 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403166 Sep 01 13:47:39.770105 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Sep 1 13:47:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:39.777288 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-67aa7a49-9000-45b6-9d74-5f608b44681b admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:39.799778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-67aa7a49-9000-45b6-9d74-5f608b44681b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026512 Sep 01 13:47:39.800304 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:39.809934 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-5154fada-e699-4023-a371-d3fb88b0ed45 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:39.832470 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-5154fada-e699-4023-a371-d3fb88b0ed45 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026088 Sep 01 13:47:39.833021 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:39.843291 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e86d1034-dbff-4048-a42c-a0bd4ceff38d admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:39.849450 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.wsgi [None req-e86d1034-dbff-4048-a42c-a0bd4ceff38d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e86d1034-dbff-4048-a42c-a0bd4ceff38d admin admin] Request method failure captured: Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept: application/json Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept-Encoding: gzip, deflate Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Connection: keep-alive Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Content-Length: 0 Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Host: 10.222.0.50 Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-System-Scope: None Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: User-Agent: python-novaclient Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Auth-Token: gAAAAABjELf7hXFr4agamZ5WfPdrD3xi86FmAb1Pr0KWAuZ8NDxLcpeCfaqW3rcRN-3t2mAGXzp9ETxVLx_SCsEY2ue6sbZV18Bhb8lBUC38z_xtaL6VPtZmvxSpVK1wfAFUa7RmpLuZTqJFm7jii-6zf6ICF1kanmiws8fDcW0VxJZ_xpoF9IU Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Id: None Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Name: None Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Identity-Status: Confirmed Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Is-Admin-Project: True Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Id: default Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Name: Default Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Name: admin Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Role: reader,admin,member Sep 01 13:47:39.852778 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Roles: reader,admin,member Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant: admin Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Name: admin Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User: admin Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Id: default Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Name: Default Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Name: admin Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: method: > Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: exception: Flavor 42 could not be found. Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: action_args: {'id': '42'} Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:39.858319 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:39.859336 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:39.860620 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e86d1034-dbff-4048-a42c-a0bd4ceff38d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:39.861825 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-e86d1034-dbff-4048-a42c-a0bd4ceff38d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015333 Sep 01 13:47:39.861825 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Sep 1 13:47:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:40.820223 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-5154fada-e699-4023-a371-d3fb88b0ed45 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:40.821231 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-5154fada-e699-4023-a371-d3fb88b0ed45 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 01 13:47:40.821623 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:41.357018 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-1c086079-bb87-4f69-8521-2ca0ac702698 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:41.363275 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.wsgi [None req-1c086079-bb87-4f69-8521-2ca0ac702698 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-1c086079-bb87-4f69-8521-2ca0ac702698 admin admin] Request method failure captured: Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept: application/json Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept-Encoding: gzip, deflate Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Connection: keep-alive Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Content-Length: 0 Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Host: 10.222.0.50 Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-System-Scope: None Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: User-Agent: python-novaclient Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Auth-Token: gAAAAABjELf87Ie57I6zgIlO8W6DTJDzd5ksXeCDqKnrZQVc31U4CLEamQ3kitqDA-5f-DAjobppDmztlmVT32Tijh4YEPLTQ-qspMv2pmgwGpWUl0eFjK5SK2YPNmf9ABEHOSRIxLNpJzCKdFhVcemU4typDLOudlCpxaZ3sfw1muumLwqhJ4E Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Id: None Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Name: None Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Identity-Status: Confirmed Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Is-Admin-Project: True Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Id: default Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Name: Default Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Name: admin Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Role: reader,admin,member Sep 01 13:47:41.364954 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Roles: reader,admin,member Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant: admin Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Name: admin Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User: admin Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Id: default Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Name: Default Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Name: admin Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: method: > Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: exception: Flavor 84 could not be found. Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: action_args: {'id': '84'} Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:41.366493 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:41.367565 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.368930 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-1c086079-bb87-4f69-8521-2ca0ac702698 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:41.370946 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-1c086079-bb87-4f69-8521-2ca0ac702698 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406291 Sep 01 13:47:41.370946 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Sep 1 13:47:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 13:47:41.376830 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-f805411f-a022-4b1a-9728-963fbc136d14 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:41.392559 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-f805411f-a022-4b1a-9728-963fbc136d14 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019284 Sep 01 13:47:41.393097 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:41.402729 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-748714ef-cafb-4eaf-98bf-c8e6f218d052 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:41.418053 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-748714ef-cafb-4eaf-98bf-c8e6f218d052 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019063 Sep 01 13:47:41.418583 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:47:41.427995 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-793a5aa9-bc82-4076-ba67-125859e75c84 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:41.434193 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.wsgi [None req-793a5aa9-bc82-4076-ba67-125859e75c84 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-793a5aa9-bc82-4076-ba67-125859e75c84 admin admin] Request method failure captured: Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept: application/json Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept-Encoding: gzip, deflate Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Connection: keep-alive Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Content-Length: 0 Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Host: 10.222.0.50 Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-System-Scope: None Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: User-Agent: python-novaclient Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Auth-Token: gAAAAABjELf87Ie57I6zgIlO8W6DTJDzd5ksXeCDqKnrZQVc31U4CLEamQ3kitqDA-5f-DAjobppDmztlmVT32Tijh4YEPLTQ-qspMv2pmgwGpWUl0eFjK5SK2YPNmf9ABEHOSRIxLNpJzCKdFhVcemU4typDLOudlCpxaZ3sfw1muumLwqhJ4E Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Id: None Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Name: None Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Identity-Status: Confirmed Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Is-Admin-Project: True Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Id: default Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Name: Default Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Name: admin Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Role: reader,admin,member Sep 01 13:47:41.435719 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Roles: reader,admin,member Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant: admin Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Name: admin Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User: admin Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Id: default Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Name: Default Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Name: admin Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: method: > Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: exception: Flavor 84 could not be found. Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: action_args: {'id': '84'} Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:41.437111 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:41.437904 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:41.439241 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-793a5aa9-bc82-4076-ba67-125859e75c84 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:41.440589 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-793a5aa9-bc82-4076-ba67-125859e75c84 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012716 Sep 01 13:47:41.440589 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Sep 1 13:47:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 13:47:42.404600 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-748714ef-cafb-4eaf-98bf-c8e6f218d052 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:42.405593 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-748714ef-cafb-4eaf-98bf-c8e6f218d052 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 01 13:47:42.406069 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:42.927610 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-67512917-caef-46a8-92ce-4081442e82c0 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:42.933646 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.wsgi [None req-67512917-caef-46a8-92ce-4081442e82c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-67512917-caef-46a8-92ce-4081442e82c0 admin admin] Request method failure captured: Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept: application/json Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Accept-Encoding: gzip, deflate Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Connection: keep-alive Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Content-Length: 0 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Host: 10.222.0.50 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Openstack-System-Scope: None Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: User-Agent: python-novaclient Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Auth-Token: gAAAAABjELf-sEg8aQ0eJBrcK7l305PAhpOuuOMf7NmIQ52Azk-_wBHeyZB7lsvlCY2_8shEyLy313HVaHSnEnD3DdFxa1-3RW0HwhWsi8yeavtTDPYo7wY6kMZiwOVLbMtLRwez0LRXdOxiDZpeDkVUuFK96biav-QuAY52suBMNj6PZMlJ1-8 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Id: None Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Domain-Name: None Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Identity-Status: Confirmed Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Is-Admin-Project: True Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Id: default Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Domain-Name: Default Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Project-Name: admin Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Role: reader,admin,member Sep 01 13:47:42.935182 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Roles: reader,admin,member Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant: admin Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-Tenant-Name: admin Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User: admin Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Id: default Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Domain-Name: Default Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: X-User-Name: admin Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: method: > Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: exception: Flavor 451 could not be found. Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: action_args: {'id': '451'} Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:42.936536 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:42.937467 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: ERROR nova.api.openstack.wsgi Sep 01 13:47:42.938687 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-67512917-caef-46a8-92ce-4081442e82c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:42.939726 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-67512917-caef-46a8-92ce-4081442e82c0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392889 Sep 01 13:47:42.939726 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:47:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:42.946100 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-1e7a88c2-ccbb-4071-846d-ddd4c39aeb7b admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:42.960987 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-1e7a88c2-ccbb-4071-846d-ddd4c39aeb7b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018372 Sep 01 13:47:42.961504 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:47:42.971395 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:42.986960 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019193 Sep 01 13:47:42.987500 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Sep 1 13:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:47:42.996586 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-5284ddec-a698-400b-8dc0-a92e54ba7bfe admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:43.001796 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.wsgi [None req-5284ddec-a698-400b-8dc0-a92e54ba7bfe admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-5284ddec-a698-400b-8dc0-a92e54ba7bfe admin admin] Request method failure captured: Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept: application/json Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Accept-Encoding: gzip, deflate Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Connection: keep-alive Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Content-Length: 0 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Host: 10.222.0.50 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-Api-Version: compute 2.90 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Openstack-System-Scope: None Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: User-Agent: python-novaclient Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Auth-Token: gAAAAABjELf-sEg8aQ0eJBrcK7l305PAhpOuuOMf7NmIQ52Azk-_wBHeyZB7lsvlCY2_8shEyLy313HVaHSnEnD3DdFxa1-3RW0HwhWsi8yeavtTDPYo7wY6kMZiwOVLbMtLRwez0LRXdOxiDZpeDkVUuFK96biav-QuAY52suBMNj6PZMlJ1-8 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Id: None Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Domain-Name: None Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Identity-Status: Confirmed Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Is-Admin-Project: True Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Id: default Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Domain-Name: Default Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Project-Name: admin Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Role: reader,admin,member Sep 01 13:47:43.003327 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Roles: reader,admin,member Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c52243fb4fdd4f1bb4f3291630bfbabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c52243fb4fdd4f1bb4f3291630bfbabe"}]}] Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant: admin Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Id: c52243fb4fdd4f1bb4f3291630bfbabe Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-Tenant-Name: admin Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User: admin Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Id: default Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Domain-Name: Default Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Id: f72e2116699d4d6889af55d666d2817d Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: X-User-Name: admin Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: method: > Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: exception: Flavor 451 could not be found. Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: action_args: {'id': '451'} Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:47:43.004977 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:43.006062 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: ERROR nova.api.openstack.wsgi Sep 01 13:47:43.007350 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-5284ddec-a698-400b-8dc0-a92e54ba7bfe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:47:43.008582 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-5284ddec-a698-400b-8dc0-a92e54ba7bfe admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011601 Sep 01 13:47:43.008582 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:47:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 13:47:43.967243 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:43.968279 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 01 13:47:43.968668 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:47:44.490230 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-3899f6d2-7aa1-4ac2-837c-06481de72e2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:44.586812 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-3899f6d2-7aa1-4ac2-837c-06481de72e2f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481213 Sep 01 13:47:44.587352 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Sep 1 13:47:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:45.565766 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:45.566772 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 01 13:47:45.567169 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:46.091077 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-9cc7a34b-c0c0-48d4-b632-75fdc582aef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:46.186551 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-9cc7a34b-c0c0-48d4-b632-75fdc582aef4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.479799 Sep 01 13:47:46.187087 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Sep 1 13:47:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:47:47.159993 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:47.160991 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 01 13:47:47.161378 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:47.683703 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-3909d2bb-dc92-4416-b041-a9046d0f8a8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:47.804495 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-3909d2bb-dc92-4416-b041-a9046d0f8a8b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.503814 Sep 01 13:47:47.805031 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Sep 1 13:47:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:48.775134 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:48.776219 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 01 13:47:48.776609 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:49.296008 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-db26d231-d21f-4cd1-8543-4cb57b497652 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:47:49.380618 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-db26d231-d21f-4cd1-8543-4cb57b497652 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.459177 Sep 01 13:47:49.380618 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Sep 1 13:47:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:50.459004 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:50.460051 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 01 13:47:50.460471 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:47:50.985514 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-f7e6d06d-cfdf-47a4-94f8-5b7684ada57b admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:47:51.006235 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-f7e6d06d-cfdf-47a4-94f8-5b7684ada57b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406334 Sep 01 13:47:51.006785 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Thu Sep 1 13:47:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:48:45.389846 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.390878 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-4f61a900-5838-4f8e-b62d-849c32f722ff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 01 13:48:45.391272 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:48:45.401743 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.787531 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-0b4ff978-c094-4024-bf5c-c28f0a7e1dfc admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.808568 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-0b4ff978-c094-4024-bf5c-c28f0a7e1dfc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411269 Sep 01 13:48:45.809099 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:48:45.829698 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG dbcounter [-] [112678] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.833355 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-b8813be8-38eb-46e5-8434-aa81ab1946e8 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.841409 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-b8813be8-38eb-46e5-8434-aa81ab1946e8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013060 Sep 01 13:48:45.841943 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:48:45.854042 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-fac0ba85-0c95-4bfc-9b60-91ddd059f650 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.862696 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-fac0ba85-0c95-4bfc-9b60-91ddd059f650 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012353 Sep 01 13:48:45.863231 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:48:45.875694 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.883693 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011564 Sep 01 13:48:45.884249 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:48:45.896292 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-e89d3a26-eb85-4d81-8c07-f393039b45fa admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:48:45.903881 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-e89d3a26-eb85-4d81-8c07-f393039b45fa admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011263 Sep 01 13:48:45.904398 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Thu Sep 1 13:48:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:52:12.567991 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:12.568996 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 01 13:52:12.569391 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:52:12.710117 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_api:SELECT=6 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:12.875086 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:12.878681 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:12.882181 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:12.882181 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:12.882181 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:12.882181 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:12.882774 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:12.916301 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-8110a058-6a3f-4c87-bac0-c27f0afaf661 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207823 Sep 01 13:52:12.916851 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:52:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:52:13.756582 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:13.757590 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 01 13:52:13.757991 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:52:13.951266 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:13.954924 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:13.955429 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:13.956374 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:13.956583 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:13.957028 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:13.957450 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:13.979800 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-0fd60e97-8d1e-4cfc-8bb9-742344e774b9 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080910 Sep 01 13:52:13.980783 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:52:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:52:25.241487 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:25.245542 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 01 13:52:25.245542 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:52:25.400978 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_cell0:SELECT=4 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:25.401784 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_cell1:SELECT=4 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:25.402407 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG dbcounter [-] [112677] Writing DB stats nova_api:SELECT=8 {{(pid=112677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:25.454338 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:25.458375 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:25.458926 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:25.459353 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:25.463438 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:25.463438 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:25.463438 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:25.488107 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-472e2ca7-e42d-4b53-96a7-1bd8fa5593be admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092280 Sep 01 13:52:25.488686 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:52:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:52:26.348514 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: DEBUG nova.api.openstack.wsgi [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] Calling method '>' {{(pid=112678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:26.349555 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: INFO nova.api.openstack.requestlog [None req-57240fed-d36a-4a00-898e-0687f905c466 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 01 13:52:26.349958 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: [pid: 112678|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Sep 1 13:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:52:26.544804 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG nova.api.openstack.wsgi [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Calling method '>' {{(pid=112677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:52:26.548308 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:26.548798 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:26.549216 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:26.549916 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:52:26.550348 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:52:26.550755 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: DEBUG oslo_concurrency.lockutils [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:52:26.571828 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: INFO nova.api.openstack.requestlog [None req-7c40fff3-7ddd-479f-9f14-a7a0be322bb8 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081440 Sep 01 13:52:26.572390 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: [pid: 112677|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Sep 1 13:52:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:53:25.500215 dv-cinder-839768-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 13:53:25.501072 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: Thu Sep 1 13:53:25 2022 - graceful shutdown triggered... Sep 01 13:53:25.501819 dv-cinder-839768-5-iscsi devstack@n-api.service[112678]: Gracefully killing worker 2 (pid: 112678)... Sep 01 13:53:25.502397 dv-cinder-839768-5-iscsi devstack@n-api.service[112677]: Gracefully killing worker 1 (pid: 112677)... Sep 01 13:53:26.502334 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: worker 1 buried after 1 seconds Sep 01 13:53:26.502334 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: worker 2 buried after 1 seconds Sep 01 13:53:26.502334 dv-cinder-839768-5-iscsi devstack@n-api.service[112676]: goodbye to uWSGI. Sep 01 13:53:26.503859 dv-cinder-839768-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 13:53:26.504411 dv-cinder-839768-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 13:53:26.507768 dv-cinder-839768-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 13:53:26.518550 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 13:53:26.522209 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:53:26 2022] *** Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: nodename: dv-cinder-839768-5-iscsi Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: machine: x86_64 Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: clock source: unix Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: pcre jit disabled Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: detected number of CPU cores: 4 Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: current working directory: / Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:53:26.522461 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: your processes number limit is 47680 Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: your memory page size is 4096 bytes Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: detected max file descriptor number: 2048 Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: lock engine: pthread robust mutexes Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: thunder lock: enabled Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 13:53:26.523157 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:53:26.574534 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: Python main interpreter initialized at 0x563871fe29c0 Sep 01 13:53:26.574534 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: python threads support enabled Sep 01 13:53:26.574534 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: your server socket listen backlog is limited to 100 connections Sep 01 13:53:26.574534 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:53:26.575119 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:53:26.575290 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: *** Operational MODE: preforking *** Sep 01 13:53:26.575783 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:53:26.575783 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: spawned uWSGI master process (pid: 127691) Sep 01 13:53:26.576012 dv-cinder-839768-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 13:53:26.578074 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: spawned uWSGI worker 1 (pid: 127708, cores: 1) Sep 01 13:53:26.578074 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: spawned uWSGI worker 2 (pid: 127709, cores: 1) Sep 01 13:53:26.578074 dv-cinder-839768-5-iscsi devstack@n-api.service[127691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:53:27.320497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:53:27.378870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:53:28.501668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:53:28.501668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: from cryptography.utils import int_from_bytes Sep 01 13:53:28.502325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:53:28.502325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: from cryptography.utils import int_from_bytes Sep 01 13:53:28.550296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:53:28.550296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: from cryptography.utils import int_from_bytes Sep 01 13:53:28.551031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:53:28.551031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: from cryptography.utils import int_from_bytes Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.071406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.072977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.072977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.072977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.072977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.072977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.073381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.073381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.073706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.074040 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-5-iscsi {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.074544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.074862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.075176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.075544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.075906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.076173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.076478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.076989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.077737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.078053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.078349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.078722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.079018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.079542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.080072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.080375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.080707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.081083 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.081570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-5-iscsi {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.081870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.082085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.082569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.083008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.083885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.084211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.084532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.084856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.085173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.085503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.085818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.086139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.086500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.086762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.087073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.087398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.087721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.088024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.088330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.088576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.088887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.089211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.089532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.089852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.090104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.090356 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.090673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.090992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.091300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.091635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.091948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.092249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.092557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.092858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.093162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.093467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.093791 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.094107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.094434 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.094735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.095116 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.095494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.095747 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.096053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.096398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.096714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.097023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.097344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.097666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.097974 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.098280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.098587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.099584 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.099844 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.100153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.100404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.100706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.101009 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.101327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.101632 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.102200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.102502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.102805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.103113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.103448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.103758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.104068 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.104375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.104755 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.104993 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.105299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.105604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.105906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.106234 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.106556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.106859 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.107166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.107506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.107816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.108140 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.108448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.108763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.109082 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.109420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.109691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.110017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.110320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.110628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.110948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.111247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.111579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.111897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.112205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.112513 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.112816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.113118 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.113420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.113722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.114029 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.114329 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.114741 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.115053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.115298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.115642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.115947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.116252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.116579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.116915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.117245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.117589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.117906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.118239 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.118570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.118890 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.119204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.119541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.119865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.120230 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.120544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.120856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.121432 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.121759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.122168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.122655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.122980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.123516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.123841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.124244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.124591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.124921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.125240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.125582 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.126020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.126475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.127078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.127413 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.127742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.128052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.128514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.128701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.129019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.129335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.129658 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.129997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.130367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.130687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.131001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.131315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.131653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.131965 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.132305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.132625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.132950 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.133268 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.133584 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.133902 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.134217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.134533 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.134845 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.135152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.135478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.135784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.136095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.136398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.136725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.137052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.137360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.137691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.137995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.138306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.138615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.138869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:53:31.139306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.139420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:53:31.139506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.139608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.139708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:53:31.139837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.140047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:53:31.140149 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.140308 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:53:31.140449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.140699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.140790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.141032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.141123 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.141359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.141503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.141664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.141756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.141968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.142060 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.142284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.142396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.142595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.142698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.142906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.142999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.143218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.143320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.143519 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.143622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.143841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.143939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.144153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.144257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-5-iscsi {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.144469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.144639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.144804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.144959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.145136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.145281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.145442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.146159 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.146376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.146527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.146702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.146806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.147019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.147112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.147323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.147630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.147756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.147948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.148053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.148251 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.148343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.148564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.148655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.148850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.148943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.149151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.149250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.149454 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.149552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.149756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.149859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.150057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.150161 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.150359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.150459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.150679 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.150771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.150987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.151125 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-5-iscsi {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.151289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.151490 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.151618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.151813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.151921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.152192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.152320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.152542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.152640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.152901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.153050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.153217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.153339 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.153536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.153661 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.153910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.154194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.154326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.154520 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.154624 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.154854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.154963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.155170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.155271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.155515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.155642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.155881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.155992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.156147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.156238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.156447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.156568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.156759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.156871 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.157070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.157223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.157553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.157855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.157963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.158132 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.158245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.158438 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.158666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.158818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.159086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.159192 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.159541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.159727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.159893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.160042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.160196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.160370 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.160519 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.160815 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.160978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.161147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.161250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.161918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.162069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.162192 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.162321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.162418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.162509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.162723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.162825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.163033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.163126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.163344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.163504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.163725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.163823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.164049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.164141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.164372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.164478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.164700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.164799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.165010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.165100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.165318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.165417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.165639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.165721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.165944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.166026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.166259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.166407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.166591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.166685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.166916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.167021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.167223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.167517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.167697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.167820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.167930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.168020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.168167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.168269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.168477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.168569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.168790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.168927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.169100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.169197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.169409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.169509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.169719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.169825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.169981 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.170082 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.170287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.170379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.170599 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.170692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.170923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.171023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.171234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.171332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.171563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.171664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.171866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.171970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.172171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.172270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.172483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.172664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.172794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.172917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.173101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.173191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.173411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.173511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.173724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.173815 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.174024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.174120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.174331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.174441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.174643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.174732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.174945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.175043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.175247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.175353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.175559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.175701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.175864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.175967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.176205 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.176307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.176513 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.176602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.176817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.177016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.177160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.177284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.177466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.177685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.177806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.177926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.178061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.178172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.178374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.178506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.178685 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.178813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.178998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.179088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.179311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.179439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.179646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.179747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.179964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.180080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.180265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.180374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.180574 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.180703 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.180881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.180975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.181200 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.181331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.181507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.181597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.181816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.181971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.182135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.182226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.182415 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.182552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.182725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.182846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.183206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.183344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.183502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.183651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.183780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.183989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.184145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.184309 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.184430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.184630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.184758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.184951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.185094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.185272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.185421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.185550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.185664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.185882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:53:31.186022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.186932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.187114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.187249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.187506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.187668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.187898 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188382 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.188895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.189199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.189502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.189808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.190198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.190512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.190818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.191128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.191454 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.191783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.192091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.192392 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.192732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.193039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.193369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.193675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.194019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.194348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.194684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.194988 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.195292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.195639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.195943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.196247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.196549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.196864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.197165 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.197467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.197782 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.198088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.198393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.198700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.198999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.199306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.199631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.199771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.199947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200151 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200836 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.200961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201150 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201339 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.201880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.202915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.203961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204471 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.204888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205195 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.205903 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206007 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206574 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.206974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.207203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.207297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.207543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.207845 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.208667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.208969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.209272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.209575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.209881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.210182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.210485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.210792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.211098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.215400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.215400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.215400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.216987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217267 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217522 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217606 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217679 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.217847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.218935 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.219007 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.219092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.219167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.219245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.219316 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.220139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.220314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.220521 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.220684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.220851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.221023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.221177 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.221322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.221322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.222312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.222487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.222704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.222865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.223010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.223155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.223298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.223535 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.223698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.224564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.224794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.224984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225159 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.225961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.226141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.226304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.226509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.226668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.227069 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.227220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.227402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.227634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.227865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228685 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.228975 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.229904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.230072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.230352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.230520 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.230735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.230892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.231065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.231215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.231391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.231585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.231846 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.232547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.232759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.232911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.233940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.234196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.234428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.234790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.234953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235108 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235797 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.235951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.236098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.236253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.236409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.236618 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.236866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.237101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.237364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.237566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.237722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.237875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238204 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.238953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.239907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.240052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.240210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.240386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.240386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.240874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.241863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.242199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243014 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243345 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.243996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.244810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.245249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.245424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.245590 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.245590 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.246917 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.247038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.247166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.247286 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.255600 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.255813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.255991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.256940 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257738 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.257884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.258107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.258284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.258467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.258709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.258882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.259033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.259201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.259479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.259746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.259915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.260076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.260240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.260475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.260638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.260809 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.261072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.261332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.261619 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.261789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.261952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.262172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.262483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.263001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.263485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.263663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.263827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.263979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.264129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.264334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.264596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.264754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.264904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.265055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.265214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.265514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.265775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.265775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266414 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.266889 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.267071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.267302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.267532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.267687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.267852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268567 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.268999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.269151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.269302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.269460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.269683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.270034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.270203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.270364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.270523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.271472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.271650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.271818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.271980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.272138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.272297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.272475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.273126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.273385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.273755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.273910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.274970 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.275128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.275343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.275833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.276904 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.277057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.277246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.277424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.277604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.277846 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278339 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.278983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.279169 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.279341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.279531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.279714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.279901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.280186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.280348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.280571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.280823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.281047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.281308 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.281697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.281948 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.282199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.282456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.282735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.283443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.283629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284466 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.284958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.285982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.286115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.286280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.286406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.287035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.287154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.287273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.287730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.287730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.288056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.288226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.288386 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.288593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.288849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.289107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.289363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.289538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.289692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.289885 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290715 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.290875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.291180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.291340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.291550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.291917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292088 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.292888 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.293790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.294076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.294482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.294641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.294831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295181 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295676 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.295846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.296029 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.296378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.296578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.296733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.296900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.297052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.297253 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.297504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.297748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.297991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.298242 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.298242 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.298602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.298778 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.298932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.299148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.299427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.299593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.299759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.299912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.300117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.300296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.300579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.300738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.300900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.301971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.302274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.302437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.302598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.302750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.302911 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.303073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.303420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.303940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.303940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.304241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.304428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.304818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.305960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.306168 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.306365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.306719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.306884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307533 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.307864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308024 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308184 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308337 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.308982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.309170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.309415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.309674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.309915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.310144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.310373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.310617 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.310966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.311210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.311554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.311817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.312064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.312328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.312703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.312968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.313211 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.313476 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.314313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.314560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.315147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.315147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.315698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.315962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.316233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.316508 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.316768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.317189 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.317358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.317572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.317750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.317906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318401 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.318883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319738 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.319968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320461 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.320973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.321240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.321397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.321565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.321782 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.321950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.322183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.322352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.322505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.322673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.322939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.323097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.323259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.323452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.323620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.323790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.324438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.324611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.324779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.324940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.325389 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.325553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.325706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.325875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326062 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326549 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.326869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.327021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.327517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.327682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.327888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.327888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.328292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.328455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.328606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.328757 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.328918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329380 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329530 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.329838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330165 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330317 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330634 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.330954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.331112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.331112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.331570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.331725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.331887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332600 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.332990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.333797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.333976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.334541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.334705 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.334866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.335080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.335524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.335695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.335849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336007 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.336951 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.337118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.337539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.337894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.338120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.338340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.338553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.338767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.338994 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.339231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.339527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.339702 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.339857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340024 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340486 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.340946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.341097 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.341255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.341517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.341688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.341848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342627 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.342936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.343127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.343347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.343604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.343855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.344250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.344855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.345018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.345298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.345767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.345928 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346734 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.346898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.347151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.347307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.347518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.347673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.347916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.348280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.348444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.348638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.349403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.349641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.349800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.349961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.350922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.351078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.351230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.351403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.351689 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.352996 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.353169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.353330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.353516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.353734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.353957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.354177 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.355020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.355198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.355379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.355541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.355949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.356936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357640 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.357943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.358285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.358558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.358717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.358875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359027 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.359870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.360028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.360205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.360205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.360494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.361196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.361368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.361532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.361703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.361905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.362062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.362213 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.362370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.362549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.363441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.363628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.363783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.363936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.364096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.364259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.364487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.364795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.365330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.365493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.365493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.365792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.366993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367513 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.367981 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.368153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.368935 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369266 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369433 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.369910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370069 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370559 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.370870 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.371030 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.371224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.371536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.371704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.371856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372336 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.372956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.373901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374683 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.374941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.375481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.375665 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.375830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.375990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.376152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.376420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.376595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.376750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377026 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.377978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.378255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.378421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.378588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.378742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.378922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.379174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.379343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.379593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.379768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.379957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.380902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381353 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381522 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.381932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382084 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382084 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.382371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.383570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.384734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.386427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.387869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.389044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.390334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.391620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.392748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.393897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.395046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.397346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.398630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.400000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.402451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.403658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.404988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.406654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.408196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.409346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.410653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.412430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.413924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.415251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.417619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.418929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.420238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421090 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO dbcounter [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Registered counter for database nova_api Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.421258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.422391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.423615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.424699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.425547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.426447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:53:31.427494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:53:31.430344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_db.sqlalchemy.engines [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.437190 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writer thread running {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.490092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO dbcounter [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Registered counter for database nova_api Sep 01 13:53:31.494527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.context [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),faee2cfd-b53c-4fee-84f6-475fe826578e(cell1) {{(pid=127708) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:53:31.498608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:53:31.499091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:53:31.500695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:53:31.501429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:53:31.502548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:53:31.504013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:53:31.506829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO dbcounter [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Registered counter for database nova_cell0 Sep 01 13:53:31.511514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO dbcounter [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Registered counter for database nova_cell1 Sep 01 13:53:31.511883 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_db.sqlalchemy.engines [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.521704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writer thread running {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.521921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_db.sqlalchemy.engines [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.522672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_db.sqlalchemy.engines [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.531828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writer thread running {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.532169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writer thread running {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.577399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.context [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),faee2cfd-b53c-4fee-84f6-475fe826578e(cell1) {{(pid=127709) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:53:31.581698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:53:31.582195 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:53:31.584579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:53:31.585615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:53:31.586462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:53:31.588988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:53:31.591383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO dbcounter [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Registered counter for database nova_cell0 Sep 01 13:53:31.596634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO dbcounter [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Registered counter for database nova_cell1 Sep 01 13:53:31.604958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_db.sqlalchemy.engines [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.607812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_db.sqlalchemy.engines [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.615262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writer thread running {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.618140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writer thread running {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.681146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO dbcounter [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Registered counter for database nova_cell0 Sep 01 13:53:31.689384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_db.sqlalchemy.engines [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.696604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writer thread running {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:31.779290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO dbcounter [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Registered counter for database nova_cell0 Sep 01 13:53:31.787837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_db.sqlalchemy.engines [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:53:31.793046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writer thread running {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:53:32.019833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: WARNING keystonemiddleware.auth_token [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:53:32.027655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: WARNING keystonemiddleware.auth_token [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:53:32.117551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: WARNING keystonemiddleware.auth_token [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:53:32.124941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: WARNING keystonemiddleware.auth_token [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:53:32.375456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: WARNING keystonemiddleware.auth_token [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:53:32.383044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: WARNING keystonemiddleware.auth_token [None req-b9708e2b-59f0-4e90-9c2b-db9d9175dc7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:53:32.388875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563871fe29c0 pid: 127708 (default app) Sep 01 13:53:32.468898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: WARNING keystonemiddleware.auth_token [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:53:32.474995 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: WARNING keystonemiddleware.auth_token [None req-2b4371fd-b8ee-4db2-a543-f0c1549a9834 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:53:32.480647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563871fe29c0 pid: 127709 (default app) Sep 01 13:54:11.072302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.076189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.076189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.076189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.578011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.579136 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.579980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.585291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:12.119480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eb3fd236-c550-4373-b7c9-acf921a43bda tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Action: 'create', calling method: .version_select at 0x7f980fc331f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1585456025", "metadata": {"Type": "work"}}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eb3fd236-c550-4373-b7c9-acf921a43bda tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 122 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.128292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1585456025", "metadata": {"Type": "work"}}} Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.129991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1585456025', 'metadata': {'Type': 'work'}}}} Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise error Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.130980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 13:54:12.134664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 13:54:12.137561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 13:54:12.137561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.137561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eb3fd236-c550-4373-b7c9-acf921a43bda tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.137561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eb3fd236-c550-4373-b7c9-acf921a43bda tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.072811 Sep 01 13:54:12.137561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1156 bytes} [Thu Sep 1 13:54:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 13:54:12.144114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cec3ef40-9da2-499d-80fc-a1cfe89b85cd tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Action: 'create', calling method: .version_select at 0x7f980fc33dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1227590288", "metadata": {"Type": "work"}}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cec3ef40-9da2-499d-80fc-a1cfe89b85cd tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 120 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.148770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1227590288", "metadata": {"Type": "work"}}} Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.150638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1227590288', 'metadata': {'Type': 'work'}}}} Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise error Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi '0' Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.151801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 13:54:12.153819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 13:54:12.157042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 13:54:12.157042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.157042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cec3ef40-9da2-499d-80fc-a1cfe89b85cd tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.157042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cec3ef40-9da2-499d-80fc-a1cfe89b85cd tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013305 Sep 01 13:54:12.157042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 2/2] 10.222.0.50 () {60 vars in 1156 bytes} [Thu Sep 1 13:54:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 13:54:12.177126 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c4105f5d-fea6-4389-bedd-ac1c9725be2a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Action: 'create', calling method: .version_select at 0x7f980fbffe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580803032", "metadata": {"Type": "work"}}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c4105f5d-fea6-4389-bedd-ac1c9725be2a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 118 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.181785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580803032", "metadata": {"Type": "work"}}} Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.183220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-580803032', 'metadata': {'Type': 'work'}}}} Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise error Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi '' Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.184183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 13:54:12.186101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 13:54:12.187323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 13:54:12.187323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.187323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c4105f5d-fea6-4389-bedd-ac1c9725be2a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.187323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c4105f5d-fea6-4389-bedd-ac1c9725be2a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022614 Sep 01 13:54:12.187323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 3/3] 10.222.0.50 () {60 vars in 1156 bytes} [Thu Sep 1 13:54:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 13:54:12.195949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f1a4d5ca-f273-417b-b3f3-5957af83ba1a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Calling method '.version_select at 0x7f980fc333a0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:12.321662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-90dd852a-4ff9-4afe-934f-f4d58802f0de tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Action: 'create', calling method: .version_select at 0x7f980fc4a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-313138174", "metadata": {"Type": "work"}}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:12.480014 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-f1a4d5ca-f273-417b-b3f3-5957af83ba1a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] HTTP exception thrown: Volume tempest-invalid-1214151061 could not be found. Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f1a4d5ca-f273-417b-b3f3-5957af83ba1a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1214151061 HTTP/1.1 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.481139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Volume tempest-invalid-1214151061 could not be found. Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'tempest-invalid-1214151061'} Sep 01 13:54:12.482660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1214151061 could not be found. (HTTP 404) (Request-ID: req-cf4b4e32-759e-4e3c-bb7a-d21a63c39be4) Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.483691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 13:54:12.484851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1214151061 could not be found. Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:12.485930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1214151061 could not be found. Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1214151061 could not be found. Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f1a4d5ca-f273-417b-b3f3-5957af83ba1a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 404 to user: Volume tempest-invalid-1214151061 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f1a4d5ca-f273-417b-b3f3-5957af83ba1a tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1214151061" status: 404 len: 99 microversion: 2.1 time: 0.293457 Sep 01 13:54:12.487804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 4/4] 10.222.0.50 () {58 vars in 1218 bytes} [Thu Sep 1 13:54:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1214151061 => generated 99 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 13:54:12.494425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f506add8-7f8a-4e04-abd5-1b8a33404228 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004620 Sep 01 13:54:12.495103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 5/5] 10.222.0.50 () {58 vars in 1140 bytes} [Thu Sep 1 13:54:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 13:54:12.507627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8d9618fb-45f3-419e-a024-98188bf7a5fc tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007134 Sep 01 13:54:12.512297 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 6/6] 10.222.0.50 () {58 vars in 1137 bytes} [Thu Sep 1 13:54:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 13:54:12.520980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-70345dd5-aad1-49c3-864a-8f264d67bd22 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Calling method '.version_select at 0x7f980fa2e160>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:12.573929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-70345dd5-aad1-49c3-864a-8f264d67bd22 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] HTTP exception thrown: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-70345dd5-aad1-49c3-864a-8f264d67bd22 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: DELETE /compute/v2.1/os-volumes/b071bfa7-4c77-48cb-93f7-de34d95d3181 HTTP/1.1 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.576744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'b071bfa7-4c77-48cb-93f7-de34d95d3181'} Sep 01 13:54:12.578232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. (HTTP 404) (Request-ID: req-1a7c7efe-ebd2-47a5-85b9-8af1c8dc154f) Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.579183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 13:54:12.580557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 13:54:12.581817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. Sep 01 13:54:12.583094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.584107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-70345dd5-aad1-49c3-864a-8f264d67bd22 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 404 to user: Volume b071bfa7-4c77-48cb-93f7-de34d95d3181 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.585452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-70345dd5-aad1-49c3-864a-8f264d67bd22 tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/b071bfa7-4c77-48cb-93f7-de34d95d3181" status: 404 len: 109 microversion: 2.1 time: 0.071650 Sep 01 13:54:12.586127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 7/7] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 13:54:12 2022] DELETE /compute/v2.1/os-volumes/b071bfa7-4c77-48cb-93f7-de34d95d3181 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 13:54:12.595752 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-95890391-235b-4a5d-bc36-31e2f0ff3dcb tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Calling method '.version_select at 0x7f980fa88a60>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:12.730151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-95890391-235b-4a5d-bc36-31e2f0ff3dcb tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] HTTP exception thrown: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-95890391-235b-4a5d-bc36-31e2f0ff3dcb tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Request method failure captured: Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/os-volumes/bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d HTTP/1.1 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmC27HH_CEqhB6nPnAtn_4PbAFzdGR3IaPINNiWfRw20-21eJEmLViSzOx4LYJvTIvEr1zNC4MhP65loQe1klxZO30LVkXmRMGDaKDWf1iKSTJLCoPXFnNJIDlatIiT6-YhRe5VC_rXsVD9pFdQ0azQcX_jSe32MmoFvs12fIXtv4M Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:54:12.732577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59789c5c55db4b6395ef40c4738eec45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59789c5c55db4b6395ef40c4738eec45"}]}] Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 59789c5c55db4b6395ef40c4738eec45 Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesNegativeTest-265784375 Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: add0f94ff060423393c124ea26ee1a8c Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesNegativeTest-265784375-project Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d'} Sep 01 13:54:12.734347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. (HTTP 404) (Request-ID: req-7b359051-de0b-4fdc-b312-ed6ff9bec258) Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.735496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 13:54:12.737044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 13:54:12.738463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-95890391-235b-4a5d-bc36-31e2f0ff3dcb tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] Returning 404 to user: Volume bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-95890391-235b-4a5d-bc36-31e2f0ff3dcb tempest-VolumesNegativeTest-265784375 tempest-VolumesNegativeTest-265784375-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d" status: 404 len: 109 microversion: 2.1 time: 0.143395 Sep 01 13:54:12.747265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 8/8] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:12 2022] GET /compute/v2.1/os-volumes/bfb356d6-0bcc-47b3-9f78-cbd4a40bbc2d => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 13:54:14.398399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-62e760f1-57e4-47a2-ba1d-a02b717f3784 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fcfbb80>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:14.429260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-90dd852a-4ff9-4afe-934f-f4d58802f0de tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.859596 Sep 01 13:54:14.431196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 1/9] 10.222.0.50 () {60 vars in 1156 bytes} [Thu Sep 1 13:54:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2863 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 13:54:14.453195 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6d6958f9-baf9-43a0-9a1d-30661bac4866 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fb240d0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:14.531884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-62e760f1-57e4-47a2-ba1d-a02b717f3784 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6f2de858-c4de-4877-b9ff-a75ebb186eed" status: 200 len: 350 microversion: 2.1 time: 0.153650 Sep 01 13:54:14.532825 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 9/10] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:14 2022] GET /compute/v2.1/os-volumes/6f2de858-c4de-4877-b9ff-a75ebb186eed => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:14.674782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6d6958f9-baf9-43a0-9a1d-30661bac4866 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 200 len: 352 microversion: 2.1 time: 0.221701 Sep 01 13:54:14.674782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 2/11] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:14 2022] GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:15.683052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-58487ee6-a9f8-4990-a51d-3ed7cf9a7786 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fa88dc0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:15.807096 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-58487ee6-a9f8-4990-a51d-3ed7cf9a7786 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 200 len: 353 microversion: 2.1 time: 0.128043 Sep 01 13:54:15.808050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 10/12] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:15 2022] GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:15.827812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9db9a73c-2497-4df4-b11f-ae9577aafa90 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fb243a0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:15.909400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9db9a73c-2497-4df4-b11f-ae9577aafa90 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 200 len: 353 microversion: 2.1 time: 0.089868 Sep 01 13:54:15.910556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 3/13] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:15 2022] GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:15.939594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cb08587e-a6e5-4572-8d68-b6aee983211c tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fa2e9d0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:16.312742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cb08587e-a6e5-4572-8d68-b6aee983211c tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 202 len: 0 microversion: 2.1 time: 0.386230 Sep 01 13:54:16.315461 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 11/14] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 13:54:15 2022] DELETE /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:54:16.332492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9dcb667f-ab04-4216-9a86-55f7a8eecd7a tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fb24820>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:16.534406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9dcb667f-ab04-4216-9a86-55f7a8eecd7a tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 200 len: 352 microversion: 2.1 time: 0.214959 Sep 01 13:54:16.540866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 4/15] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:16 2022] GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:16.600502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cf73bcfb-6648-4aeb-b49f-df6c89edc949 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa32040>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:16.724664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cf73bcfb-6648-4aeb-b49f-df6c89edc949 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d1ed8347-682d-471b-b582-08972b5c2d2b" status: 200 len: 351 microversion: 2.1 time: 0.132072 Sep 01 13:54:16.726458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 12/16] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:16 2022] GET /compute/v2.1/os-volumes/d1ed8347-682d-471b-b582-08972b5c2d2b => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:17.549916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-52e525df-e245-4bde-815d-1189f103e986 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Calling method '.version_select at 0x7f980fb24ee0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:17.677199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-52e525df-e245-4bde-815d-1189f103e986 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] HTTP exception thrown: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-52e525df-e245-4bde-815d-1189f103e986 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Request method failure captured: Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 HTTP/1.1 Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmDRXu9vVRgIqr5U5cNs_JkyP4LABP_9bnorslTbt9Fs3nhYvHHCIEOrYdw3aoCvDcMm3XnojWoYmppOmzX3IU7ofy8AX67LAnzle7bc1Zx9q7GUkMtOKWYouDgYNfcVEAsNf_BqESpm4UBgqbKlAqC0nHUN4NpdZKCTs1B2iEKSFs Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 8301923dd09442f7a43bf28f66ce7fcf Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-VolumesGetTestJSON-1509324210 Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:54:17.682708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8301923dd09442f7a43bf28f66ce7fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8301923dd09442f7a43bf28f66ce7fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8301923dd09442f7a43bf28f66ce7fcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8301923dd09442f7a43bf28f66ce7fcf"}]}] Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-VolumesGetTestJSON-1509324210 Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 8301923dd09442f7a43bf28f66ce7fcf Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-VolumesGetTestJSON-1509324210 Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-VolumesGetTestJSON-1509324210-project Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: a199c1f27219455eb24fb1ff2a373aec Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-VolumesGetTestJSON-1509324210-project Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '6eb12cbc-82a2-4655-ad10-2d4e6be76895'} Sep 01 13:54:17.684108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. (HTTP 404) (Request-ID: req-18de5572-ee3b-4270-96b6-e9dc227dcd86) Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:17.684882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 13:54:17.685966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 13:54:17.687072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-52e525df-e245-4bde-815d-1189f103e986 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] Returning 404 to user: Volume 6eb12cbc-82a2-4655-ad10-2d4e6be76895 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-52e525df-e245-4bde-815d-1189f103e986 tempest-VolumesGetTestJSON-1509324210 tempest-VolumesGetTestJSON-1509324210-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895" status: 404 len: 109 microversion: 2.1 time: 0.145444 Sep 01 13:54:17.693526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 5/17] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:17 2022] GET /compute/v2.1/os-volumes/6eb12cbc-82a2-4655-ad10-2d4e6be76895 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:54:18.922644 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8bdaf192-04b4-433c-9466-053ab06bbfd0 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa2e5e0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:19.060532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8bdaf192-04b4-433c-9466-053ab06bbfd0 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/55fc1c13-9354-4d0c-94aa-29db5f1388e0" status: 200 len: 350 microversion: 2.1 time: 0.144876 Sep 01 13:54:19.061076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 13/18] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 13:54:18 2022] GET /compute/v2.1/os-volumes/55fc1c13-9354-4d0c-94aa-29db5f1388e0 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:19.076534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5bfb4399-6e55-466d-908e-858de5eb1054 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa7e820>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:19.235182 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5bfb4399-6e55-466d-908e-858de5eb1054 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.162418 Sep 01 13:54:19.235812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 6/19] 10.222.0.50 () {58 vars in 1134 bytes} [Thu Sep 1 13:54:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:19.252413 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0151d4d1-e289-4e58-abfb-036160b290ff tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa88940>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:19.487911 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0151d4d1-e289-4e58-abfb-036160b290ff tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.240411 Sep 01 13:54:19.499132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 14/20] 10.222.0.50 () {58 vars in 1149 bytes} [Thu Sep 1 13:54:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:19.508854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cde195a5-d411-4569-9aff-940e6248472c tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa7ec10>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:19.789220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cde195a5-d411-4569-9aff-940e6248472c tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.290430 Sep 01 13:54:19.790312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 7/21] 10.222.0.50 () {58 vars in 1134 bytes} [Thu Sep 1 13:54:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:19.804341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8e27d01e-babe-4c19-b641-798e95be8ca0 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa32280>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:19.962332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8e27d01e-babe-4c19-b641-798e95be8ca0 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.162322 Sep 01 13:54:19.963868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 15/22] 10.222.0.50 () {58 vars in 1167 bytes} [Thu Sep 1 13:54:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:19.977334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-32dd3fdf-e8be-437a-b899-31f28df3473f tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980faaa3a0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:20.145949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-32dd3fdf-e8be-437a-b899-31f28df3473f tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.167866 Sep 01 13:54:20.145949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 8/23] 10.222.0.50 () {58 vars in 1170 bytes} [Thu Sep 1 13:54:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:20.158547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-033e124b-ba81-4287-9e03-3fa8f9b4d849 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa328b0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:20.409147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-033e124b-ba81-4287-9e03-3fa8f9b4d849 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.255231 Sep 01 13:54:20.413502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 16/24] 10.222.0.50 () {58 vars in 1155 bytes} [Thu Sep 1 13:54:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:20.425215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e1c84181-5809-4131-93d1-79249a8bb22a tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa955e0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:20.731570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e1c84181-5809-4131-93d1-79249a8bb22a tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.308257 Sep 01 13:54:20.732305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 9/25] 10.222.0.50 () {58 vars in 1188 bytes} [Thu Sep 1 13:54:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:20.746045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b6e060f4-f89f-4e83-b5bf-f3820010e9a2 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] Calling method '.version_select at 0x7f980fa88820>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:20.948552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b6e060f4-f89f-4e83-b5bf-f3820010e9a2 tempest-VolumesTestJSON-220306349 tempest-VolumesTestJSON-220306349-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.206285 Sep 01 13:54:20.950358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 17/26] 10.222.0.50 () {58 vars in 1155 bytes} [Thu Sep 1 13:54:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:27.760070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1ce64640-8a48-461f-bcca-c49fea439a5a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: .version_select at 0x7f980fb24ee0>, body: {"keypair": {"name": "tempest-keypair-1342911077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdU0PvUBXgy+5hYdC7naitPwXdpOltykJbOqLnoiPLoivGVzE6futu86u+h3Vs3EYdP0n5DY9VPvXVkm+bFMt3Qx7pQau1SUdg/he0Vt4R01QH3mTRqGS9NOXNGm0CuJw=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:27.883135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1ce64640-8a48-461f-bcca-c49fea439a5a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for project b0d00b24399a40d2b070bfd90e73f407. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:54:27.891040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1ce64640-8a48-461f-bcca-c49fea439a5a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for user e35ebc3dbc1f4f348f97041627fc68b9 and project b0d00b24399a40d2b070bfd90e73f407. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:54:28.135984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1ce64640-8a48-461f-bcca-c49fea439a5a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.914019 Sep 01 13:54:28.135984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 10/27] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 13:54:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:31.268683 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-56147205", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:31.518546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] validate_networks() for [('4cc01e5c-b3f0-4a35-bb32-d14ad308530f', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:54:31.765626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1800285320", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "networks": [{"uuid": "5ca0623f-a804-4aef-9dad-ca94feaec5c3"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:32.057518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] validate_networks() for [('5ca0623f-a804-4aef-9dad-ca94feaec5c3', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:54:33.918025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:54:33.921559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:54:33.922313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:54:33.922857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:54:33.923408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:54:33.965596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:33.966599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:33.969672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:33.970608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:33.973874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:33.974691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:34.022779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:54:34.034327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for user 5a441adf6eee4ba78992aafbbf02f1c8 and project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:54:34.052768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:54:34.056039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:54:34.244821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cd0224f6-0fe5-4aab-a220-50d5d207c12d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.671041 Sep 01 13:54:34.245758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 18/28] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:54:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:54:34.259523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b0c8098f-2b48-4aba-8fef-f47e41cb7bac tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:34.260156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b0c8098f-2b48-4aba-8fef-f47e41cb7bac tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:34.421113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b0c8098f-2b48-4aba-8fef-f47e41cb7bac tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:34.445630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b0c8098f-2b48-4aba-8fef-f47e41cb7bac tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1220 microversion: 2.1 time: 0.190886 Sep 01 13:54:34.459692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 19/29] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:34 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1220 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:34.493384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1188214792", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5f5944a-2d48-446c-99f1-160fb52986fb"}], "security_groups": [{"name": "tempest-securitygroup--1413861449"}], "key_name": "tempest-keypair-1342911077", "user_data": "}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:34.641301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] validate_networks() for [('e5f5944a-2d48-446c-99f1-160fb52986fb', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:54:35.008722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:54:35.009171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:54:35.009835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:54:35.010403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:54:35.010820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:54:35.031482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:35.032913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:35.033455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:35.034303 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:35.034868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:35.035406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:35.069978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Getting quotas for project 32099e5371e84253afb8de38c9c06a82. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:54:35.075955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Getting quotas for user 90c2ce45096e4fb493314ad3af039724 and project 32099e5371e84253afb8de38c9c06a82. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:54:35.109358 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:54:35.115564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:54:35.184770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:54:35.185396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:54:35.186013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:54:35.186694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:54:35.188668 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:54:35.215616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:35.216337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:35.217546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:35.225401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:35.226394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:35.227248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:35.306052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for project b0d00b24399a40d2b070bfd90e73f407. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:54:35.319948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for user e35ebc3dbc1f4f348f97041627fc68b9 and project b0d00b24399a40d2b070bfd90e73f407. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:54:35.336104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9ba28364-1995-4a5a-a7aa-ad82b54af23e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.320548 Sep 01 13:54:35.337842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 11/30] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:54:35.351211 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-553583793", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:35.382290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:54:35.396787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:54:35.494416 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] validate_networks() for [('4cc01e5c-b3f0-4a35-bb32-d14ad308530f', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:54:35.665700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5e454e12-1b1d-4e5a-9aa0-c2b16b20f5dc tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.176821 Sep 01 13:54:35.666702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 20/31] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:54:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 13:54:35.677568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-87158f73-9e9e-498e-b261-45d8b2c17b39 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:35.678198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-87158f73-9e9e-498e-b261-45d8b2c17b39 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:35.870129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-87158f73-9e9e-498e-b261-45d8b2c17b39 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:35.881235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-87158f73-9e9e-498e-b261-45d8b2c17b39 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1215 microversion: 2.1 time: 0.211177 Sep 01 13:54:35.885408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 21/32] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:35 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:35.890594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f5ae9383-05ac-430d-8628-6f534a114a16 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:35.894906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f5ae9383-05ac-430d-8628-6f534a114a16 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:36.160784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f5ae9383-05ac-430d-8628-6f534a114a16 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:36.172090 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f5ae9383-05ac-430d-8628-6f534a114a16 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1238 microversion: 2.1 time: 0.284194 Sep 01 13:54:36.175411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 22/33] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:35 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1238 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:36.524924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:54:36.525403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:54:36.530365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:54:36.530365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:54:36.530365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:54:36.537579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:36.538043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:36.538472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:36.539190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:36.539674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:36.540091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:36.574806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:54:36.585858 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for user 5a441adf6eee4ba78992aafbbf02f1c8 and project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:54:36.605332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:54:36.609348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:54:36.843941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bfbd5e82-868d-4212-a26c-de31c6c5c858 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.504800 Sep 01 13:54:36.856324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a8daa88a-60c4-4930-af2f-1f5768985d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:36.856933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a8daa88a-60c4-4930-af2f-1f5768985d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:36.859647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 12/34] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:54:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:54:36.904240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fbc9d651-65fc-40e4-beed-9c84e9217d00 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:36.904860 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fbc9d651-65fc-40e4-beed-9c84e9217d00 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:36.924258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a8daa88a-60c4-4930-af2f-1f5768985d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:36.953084 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a8daa88a-60c4-4930-af2f-1f5768985d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1221 microversion: 2.1 time: 0.087688 Sep 01 13:54:36.970230 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 23/35] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:36 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:37.079292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fbc9d651-65fc-40e4-beed-9c84e9217d00 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:37.105125 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fbc9d651-65fc-40e4-beed-9c84e9217d00 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1215 microversion: 2.1 time: 0.204519 Sep 01 13:54:37.106272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 13/36] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:36 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:37.198620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dde7a679-93a0-41cf-9772-72ad081b76e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:37.199786 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dde7a679-93a0-41cf-9772-72ad081b76e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:37.316172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dde7a679-93a0-41cf-9772-72ad081b76e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:37.324341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dde7a679-93a0-41cf-9772-72ad081b76e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1238 microversion: 2.1 time: 0.129900 Sep 01 13:54:37.329819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 24/37] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:37 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:37.964119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-944e226f-f0e0-430d-a356-1b5fa812c725 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:37.965507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-944e226f-f0e0-430d-a356-1b5fa812c725 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:38.080898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-944e226f-f0e0-430d-a356-1b5fa812c725 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:38.090234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-944e226f-f0e0-430d-a356-1b5fa812c725 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1221 microversion: 2.1 time: 0.131889 Sep 01 13:54:38.092038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 14/38] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:37 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:38.137663 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:38.138885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:38.171996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:38.173598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:38.175314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:38.176962 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:38.178904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:38.179633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:38.346681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:38.347343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:38.383247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:38.384975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:38.387308 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:38.392019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:38.392019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:38.392019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:38.607071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:38.666226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5322c49b-ec16-47fd-be1a-35f1478ca992 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1219 microversion: 2.1 time: 0.537011 Sep 01 13:54:38.671982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 25/39] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:38 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1219 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:38.765338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:38.786685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1df1a63a-f0ef-4c2c-8c1b-239e462cc440 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1242 microversion: 2.1 time: 0.445482 Sep 01 13:54:38.789782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 15/40] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:38 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1242 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:39.121963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:39.122580 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:39.133831 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.134329 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.134768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.135525 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.136202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.136595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.207401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:39.215826 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-586d3a86-fa2d-4b4c-ac38-b22ebb1e7ba8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1273 microversion: 2.1 time: 0.097522 Sep 01 13:54:39.216446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 26/41] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:39 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:39.719507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:39.723471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:39.745044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.747705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.748585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.752068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.754093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.755345 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.809301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:39.809926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:39.819838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.820627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.821187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.822251 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:39.825850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:39.831848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:39.908074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:39.921446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-39f0d4ba-d7ce-467c-af11-0696ac2eea6b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1267 microversion: 2.1 time: 0.215668 Sep 01 13:54:39.922070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 16/42] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:39 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:39.966313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:39.977351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8d40a4cb-768d-48eb-a82a-bc73baf413ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1290 microversion: 2.1 time: 0.172063 Sep 01 13:54:39.980905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 27/43] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:39 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:40.258232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:40.262371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:40.281953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:40.285626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:40.285626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:40.300956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:40.301844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:40.303622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:40.506758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:40.516897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a413445c-be54-48f7-9188-980fba17c329 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1273 microversion: 2.1 time: 0.277239 Sep 01 13:54:40.517706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 17/44] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:40 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:40.942012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:40.942654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:40.964509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:40.965018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:40.965497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:40.966220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:40.966677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:40.967107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:40.998612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:40.999954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:41.014378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:41.014378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:41.014764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:41.017573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:41.019506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:41.020170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:41.223493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:41.252143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1a512451-2595-44c7-9319-883797101379 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1285 microversion: 2.1 time: 0.313806 Sep 01 13:54:41.255871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 28/45] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:40 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:41.356635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:41.408227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0120c123-2c0e-4f4b-aa06-1284cc9d5423 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1296 microversion: 2.1 time: 0.380530 Sep 01 13:54:41.408227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 18/46] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:40 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1296 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:41.538028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:41.538648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:41.544813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:41.545486 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:41.546080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:41.550766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:41.550766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:41.550766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:41.677737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:41.688296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-041138d0-c3ff-466e-8766-b66b0ff39091 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1291 microversion: 2.1 time: 0.153919 Sep 01 13:54:41.689540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 29/47] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:41 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1291 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:42.284766 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:42.286963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:42.296982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.297712 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.305447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.310201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.311835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.313410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.398733 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:42.399910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:42.411822 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.426247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.428523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.429477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.431577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.433680 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.483901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:42.504750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6df22748-75cb-47db-8ffe-cc633464bde0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1273 microversion: 2.1 time: 0.220082 Sep 01 13:54:42.505846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 19/48] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:42 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:42.684640 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:42.716091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:42.720912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:42.753373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.756066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9fe1c6c9-d7f6-42f2-a9a5-982b351d4801 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1296 microversion: 2.1 time: 0.346211 Sep 01 13:54:42.758463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 30/49] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:42 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1296 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:42.768108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.768671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.769478 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:42.769888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:42.770338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:42.867993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:42.878558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c3927f5e-eff1-4b60-aa5a-749473e7c623 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1279 microversion: 2.1 time: 0.169600 Sep 01 13:54:42.879120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 20/50] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:42 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:43.527315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:43.528859 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:43.539576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.540295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.541878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:43.546042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.546612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.553132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:43.787306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:43.790034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:43.806116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.807025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.807666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:43.808550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.810770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.811517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:43.845857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:43.857024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9985add5-f027-4d01-93b0-5fd3d56a4b90 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.334183 Sep 01 13:54:43.857900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 31/51] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:43 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:43.902261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:43.902977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:43.909713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.910278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.910819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:43.911612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:43.912129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:43.912694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:44.007091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:44.016375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-aaec3c97-6b71-4962-9535-0a46b54d0a8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.241159 Sep 01 13:54:44.017313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 21/52] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:43 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:44.091678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:44.101359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f46e43fe-cfe5-4812-b9a3-69cf09fb14a9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.202335 Sep 01 13:54:44.103405 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 32/53] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:43 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:44.881287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:44.881897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:44.888077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:44.888563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:44.889001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:44.889694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:44.890152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:44.890576 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:45.028617 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:45.041028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9ea9807c-75e3-4a70-acb5-b273cb7d4364 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.163367 Sep 01 13:54:45.041611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 22/54] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:44 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:45.043475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:45.044102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:45.055569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:45.055569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:45.055569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:45.055569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:45.055858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:45.055858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:45.127096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:45.127096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:45.134030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:45.134694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:45.141056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:45.142208 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:45.144056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:45.144911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:45.224871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:45.258028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d0270562-9e06-46f0-a98f-d3f7ac6834f4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.224254 Sep 01 13:54:45.261093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 33/55] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:45 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:45.473049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:45.481837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f370a684-264b-4223-82c5-4f009df085f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.363102 Sep 01 13:54:45.483085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 23/56] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:45 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:46.073833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:46.074503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:46.076605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:46.082298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.082764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.083399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.084373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.084916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.085341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.228112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:46.237353 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5c2597ef-130f-41f2-9bd8-f9aea91a4287 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.167362 Sep 01 13:54:46.237939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 34/57] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:46 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:46.279510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:46.280129 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:46.286948 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.287483 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.287925 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.288631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.289807 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.289807 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.502843 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:46.503508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:46.504993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:46.510206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.513571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.513571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.513571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:46.513571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:46.514075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:46.514146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fdbef21d-8cee-456c-9789-79fbc5f9c040 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.237994 Sep 01 13:54:46.517254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 24/58] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:46 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:46.665374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:46.675785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-069325e4-4365-4315-8fbc-a8a0ec4c128b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.176720 Sep 01 13:54:46.676698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 35/59] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:46 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:47.262726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:47.266668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:47.266668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:47.271286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.271810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.272238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.272929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.273556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.273979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.525233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:47.534912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:47.535557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:47.548672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b7a9319b-e78f-4a31-b247-1e0e48fa3333 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.285284 Sep 01 13:54:47.549601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=22 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:47.559544 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 25/60] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:47 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:47.566416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.566416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.566416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.566416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.566893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.566893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.700443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:47.701066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:47.713780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.714275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.714710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.715442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:47.715896 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:47.716328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:47.805430 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:47.814112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-173921f9-3721-42de-a175-ee09ebabd192 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.283849 Sep 01 13:54:47.829599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 36/61] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:47 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:47.979281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:47.989258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7ace6b98-884a-415d-916f-b6e5c75ae289 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.292996 Sep 01 13:54:48.003233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 26/62] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:47 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:48.573022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:48.575613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:48.583896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:48.584672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:48.585551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:48.586810 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:48.587481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:48.588090 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:48.733140 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:48.741452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-436884d6-13cb-43bd-af04-157074ecf64b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.172668 Sep 01 13:54:48.742139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 37/63] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:48 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:48.837283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:48.848664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:48.851073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=20 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:48.856518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:48.857101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:48.857607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:48.858384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:48.858936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:48.859964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:49.011489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:49.012466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:49.020421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:49.021560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:49.022371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:49.023832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:49.024539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:49.025344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:49.050798 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:49.061670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-73c91cd8-13b1-463e-a894-af13a68aa165 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.227939 Sep 01 13:54:49.076509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 27/64] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:48 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:49.243771 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:49.253842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-09dcf22e-7db5-47e0-ac7a-5f4976f5cbf9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.247134 Sep 01 13:54:49.254693 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 38/65] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:49 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:49.762355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:49.763350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:49.770990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:49.773267 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:49.774801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:49.777468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:49.778402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:49.779054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:49.966145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:49.978081 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f2093bee-95b1-4746-a170-6da6bbccfa09 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.219676 Sep 01 13:54:49.978994 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 28/66] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:49 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:50.091346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:50.092637 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:50.102451 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:50.103551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:50.104494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:50.107431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:50.108762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:50.110345 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:50.277250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:50.281422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:50.299817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:50.303176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:50.303707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:50.307275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:50.314101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:50.314101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:50.314101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:50.314562 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-74417121-6c7e-408e-a4ac-a2b5827206e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.231919 Sep 01 13:54:50.327438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 39/67] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:50 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:50.560592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:50.571263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d50c15ee-87c6-49ed-b6cc-2919b904d83d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.299407 Sep 01 13:54:50.573662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 29/68] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:50 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:51.008055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:51.008802 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:51.034585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.034585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.034585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.034585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.035474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.035474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.185012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:51.190339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:51.197495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3d3c48af-5582-461c-b97c-bdafbb4adaff tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.201159 Sep 01 13:54:51.198675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 40/69] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:50 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:51.634794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:51.634794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:51.634794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.634794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.637288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.637288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.637288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.637288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.637577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:51.637577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:51.637577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-76df9c22-2665-465f-aca4-d78e292c683d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.185573 Sep 01 13:54:51.637577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 30/70] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:51 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:51.637973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:51.637973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:51.637973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.637973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.638290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.638290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:51.638290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:51.638290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:51.798510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:51.808377 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f8b73cbf-6556-444c-ab05-d1b9644c4824 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.217877 Sep 01 13:54:51.809871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 41/71] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:51 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:52.221826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:52.222837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:52.230425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.231186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.231805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:52.232713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.233411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.234014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:52.423229 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:52.430846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-eefef476-ad1d-4453-af84-cdbe0c975cef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.213813 Sep 01 13:54:52.431930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 31/72] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:52 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:52.654817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:52.655457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:52.664114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.665161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.665161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:52.665833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.666322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.666738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:52.836457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:52.837882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:52.838080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:52.848713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.848989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0147a314-d6f8-4d93-9f98-03abf2ae396b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.199209 Sep 01 13:54:52.849580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.849719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 42/73] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:52 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:52.850552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:52.851539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:52.852173 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:52.852756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:53.044598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:53.055035 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d6d36138-82a6-4695-9219-8db0cbb5d7b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.226067 Sep 01 13:54:53.068834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 32/74] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:52 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:53.458408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:53.458956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:53.475339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:53.478046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:53.478504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:53.479278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:53.480423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:53.481588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:53.720392 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:53.743056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-063b010a-321b-4ef1-bbc5-f9609a3f5d59 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.294117 Sep 01 13:54:53.762067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 43/75] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:53 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:53.872317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:53.872975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:53.891545 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:53.892408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:53.893002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:53.894015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:53.894631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:53.896073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:54.079391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:54.083961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:54.095551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:54.096244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:54.097231 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:54.098226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:54.099082 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:54.099767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:54.356038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:54.367098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-19af684c-43f0-45a8-8b00-ff6b82ead47d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.499675 Sep 01 13:54:54.377043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:54.380651 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 33/76] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:53 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:54.404172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-98958bc6-f315-47b4-946c-879285468483 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.331390 Sep 01 13:54:54.407738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 44/77] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:54 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:54.769292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:54.770311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:54.776739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:54.777409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:54.777914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:54.778696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:54.779222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:54.779739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:55.326065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:55.337226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a088bb3c-e751-4694-bbee-064023d9a99b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.572322 Sep 01 13:54:55.338274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 34/78] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:54 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:55.401428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:55.403970 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:55.433838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:55.433838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:55.438285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:55.443117 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:55.445248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:55.448699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:55.450381 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:55.452112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:55.452715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:55.456403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:55.463253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:55.463253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:55.463253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:55.463253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:55.928190 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:55.933507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:55.942134 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1a842fd9-44fd-4307-abf5-4a250e80ac48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.517618 Sep 01 13:54:55.942732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 35/79] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:55 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:55.951902 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ca08ce32-9822-4388-a411-285b0fc443d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.555155 Sep 01 13:54:55.954240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 45/80] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:55 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:56.358557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:56.359408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:56.366291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.367127 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.367835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.368787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.369464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.370097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.765781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd192f7-8775-4aa6-b31c-55b0d16aa6c7", "tag": "910a478c-75dd-4598-95e4-2c4cea800092"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:56.778412 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.779152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.779762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.800694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Creating event network-changed:910a478c-75dd-4598-95e4-2c4cea800092 for instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 on hv-cinder-83976 Sep 01 13:54:56.801223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 13:54:56.801609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-8a460722-f45c-43ca-aed6-c15b2ca861e4 req-67bf3349-e2a9-4e6e-9e30-1a1dc4bc56ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=127708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 13:54:56.802788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.803241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.803694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.804438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.805105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.805674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.815702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.compute.rpcapi [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 13:54:56.817403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:56.817864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] Releasing lock "compute-rpcapi-router" {{(pid=127708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 13:54:56.852261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5b6fff33-7de2-4ffd-a6ef-3ddfa0843d96 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192543 Sep 01 13:54:56.852699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-222ac96b-0997-437a-be78-c0d533837704 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.497926 Sep 01 13:54:56.854154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 46/81] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:54:56.866947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 36/82] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:56 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:56.980151 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:56.981009 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:56.985105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:56.985931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:56.994253 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:56.995001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.998156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:56.998534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.999007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:56.999688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:56.999808 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:57.000217 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:57.002562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:57.003842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:57.005618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:57.006335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:57.007594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:57.463677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:57.483661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-18898587-5011-450b-85c6-410c90272021 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.506989 Sep 01 13:54:57.483661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 47/83] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:56 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:57.565901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:57.578225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b1c0c976-91e5-4079-8a46-fe184712cd73 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.603380 Sep 01 13:54:57.579595 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 37/84] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:56 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:57.883526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:57.884145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:57.891586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:57.893889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:57.895135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:57.895864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:57.899183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:57.899936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:57.900559 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.017115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a22d8a7-f4bf-464d-9328-25d174ce84d8", "tag": "ff817d23-cdea-4bcb-8e2e-d93179571285"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:58.023008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.025239 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.025726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.054050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] Creating event network-changed:ff817d23-cdea-4bcb-8e2e-d93179571285 for instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 on hv-cinder-83976 Sep 01 13:54:58.061561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-b4ac0cd9-6410-4740-b5a3-c6d780b38160 req-a43a9690-2e58-4a09-b140-5e3cb9fa6754 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577194 Sep 01 13:54:58.067928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 48/85] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:58.195312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:58.205666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b059f686-8c00-4829-a456-c684c23df167 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.335145 Sep 01 13:54:58.222240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 38/86] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:57 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:58.507275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:58.508020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:58.517484 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.518237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.518726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.519542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.519984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.520600 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.603319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:58.604527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:58.612532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.619219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.620916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.623309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.624486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.627144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.782977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:58.790843 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cf35cbc1-1ea9-40d2-bc9a-86c7c088eab6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.289357 Sep 01 13:54:58.791751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 49/87] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:58 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:58.891929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f03e0d8-29d4-41d8-9275-86fb779cab41", "tag": "55fca74a-4596-432e-a05f-27d0507f84b7"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:58.908500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:58.909172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:58.909734 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:58.937276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:58.959670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5bd83905-4449-4b42-b444-583a4f96db02 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.356998 Sep 01 13:54:58.980103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 39/88] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:58 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:58.991502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] Creating event network-changed:55fca74a-4596-432e-a05f-27d0507f84b7 for instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 on hv-cinder-83976 Sep 01 13:54:59.005399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-80694865-99ff-4120-b2e0-2900c30e09ff req-7fdde16f-7eaa-4695-ad3f-bcecf3f08efc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117844 Sep 01 13:54:59.007656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 50/89] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:54:59.233066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:59.234417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:59.247305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:59.250685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:59.250685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:59.255805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:59.256591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:59.256813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:59.488674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:54:59.505675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4392195a-4f3e-4f17-905a-9c5e6b34fe2d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.272286 Sep 01 13:54:59.511473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 40/90] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:59 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:54:59.818001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:59.820414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:54:59.832257 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:59.833096 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:59.837624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:59.841358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:54:59.843523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:54:59.843523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:54:59.995028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:59.996377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:00.012221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.012221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.012221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.012221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.012982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.012982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.303849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:00.313508 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fcd5d579-d512-47f5-8c3e-f32b569bfe60 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.331811 Sep 01 13:55:00.323412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 41/91] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:59 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:00.331330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4925f2c9-4e1b-4fdb-bbc1-bb409727546d", "tag": "e211de0e-0032-40b9-9347-9565351509d2"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:00.363840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.366235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.366892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.377868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:00.386250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6f89e3de-d40b-464e-b703-81a7e484c5dd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.576312 Sep 01 13:55:00.390803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 51/92] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:54:59 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:00.418550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Creating event network-changed:e211de0e-0032-40b9-9347-9565351509d2 for instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d on hv-cinder-83976 Sep 01 13:55:00.420225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 13:55:00.422498 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-a872606f-a4de-4491-94d0-e170f88d9d46 req-3619ad5b-ee34-4869-a376-f486e20ad29e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 13:55:00.423791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.425482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.426622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.434447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.435397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.435986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.461934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.compute.rpcapi [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 13:55:00.475203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] Releasing lock "compute-rpcapi-router" {{(pid=127709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 13:55:00.497487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f4aa5c33-9c8e-4f2b-beb9-b123b8d77ba9 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176280 Sep 01 13:55:00.498444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 42/93] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:00.526999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:00.527639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:00.539125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.546373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.546373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.546373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:00.546373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:00.546756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:00.789227 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:00.799908 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-51ed61f6-58c7-4a08-b9ae-c731eb670d60 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.276635 Sep 01 13:55:00.813418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 52/94] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:00 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:01.336793 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:01.339308 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:01.359863 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:01.360734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:01.361961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:01.365095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:01.369056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:01.372707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:01.414546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:01.415156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:01.427530 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:01.428732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:01.436992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:01.438571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:01.439351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:01.440931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:02.005264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:02.015765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3e977426-8cec-4a03-bea4-1fcd457ccdd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.683466 Sep 01 13:55:02.018751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 43/95] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:01 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:02.029504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:02.031797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:02.044756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:02.047870 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:02.048622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:02.051507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:02.052457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:02.053114 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:02.655500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:02.670249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7ce8220a-f628-4c67-9b58-d9aca5a3c52f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 1.259671 Sep 01 13:55:02.672196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 53/96] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:01 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:03.065016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:03.082111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dc3bb542-7993-423a-bf24-0fd7ca292f05 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 1.058118 Sep 01 13:55:03.096336 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 44/97] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:02 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:03.102933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:03.106984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:03.111764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:03.112407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:03.113011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:03.113868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:03.114520 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:03.115089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:03.195337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd192f7-8775-4aa6-b31c-55b0d16aa6c7", "name": "network-vif-plugged", "status": "completed", "tag": "910a478c-75dd-4598-95e4-2c4cea800092"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:03.219295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:03.234121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:03.234675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:03.255247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] Creating event network-vif-plugged:910a478c-75dd-4598-95e4-2c4cea800092 for instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 on hv-cinder-83976 Sep 01 13:55:03.270180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-4205b6a4-dfc4-4050-a1f7-f203bb9976c0 req-beb8e90a-708a-4515-891d-781593831e38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271571 Sep 01 13:55:03.274839 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 54/98] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:03.313439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:03.323639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8169b04e-f01c-491d-af76-77d8302e3011 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.225952 Sep 01 13:55:03.329985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 45/99] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:03 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:03.696882 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:03.714348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:03.740642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:03.741147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:03.741582 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:03.742284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:03.742731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:03.743182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:04.138619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:04.139234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:04.153622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:04.157656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:04.158457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:04.159383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:04.160000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:04.160831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:04.512622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:04.522157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a1e64a4b-038c-4359-8b12-1cd14c79cdc5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.391063 Sep 01 13:55:04.535390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 46/100] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:04 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:04.540084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:04.540757 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:04.552224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:04.552815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:04.557663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:04.559456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:04.559952 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:04.560924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:04.746971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:04.761314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-29ee5366-2a2f-45ff-bf3d-0a051cf20391 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 1.066803 Sep 01 13:55:04.762727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 55/101] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:03 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:04.790389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:04.794288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:04.799650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dc2aaa99-0f58-4ea7-b95e-216cc786db97 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.268103 Sep 01 13:55:04.800448 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 47/102] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:04 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:05.546236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:05.546856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:05.553431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.554424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.555105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:05.556616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.557299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.557932 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:05.786345 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:05.786345 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:05.797555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.798062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.798502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:05.802754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.803548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.804303 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:05.900603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:05.916909 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5c685558-8a97-4f85-b29c-569bc8d7d8e6 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.375790 Sep 01 13:55:05.930703 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 56/103] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:05 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:05.942670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:05.944873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:05.959839 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.961449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.961925 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:05.962671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:05.963134 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:05.963586 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:06.154793 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:06.170960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9ff67a4a-d865-405e-9e65-7121b040e832 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.390125 Sep 01 13:55:06.173085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 48/104] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:05 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:06.377883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:06.378099 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f03e0d8-29d4-41d8-9275-86fb779cab41", "name": "network-vif-plugged", "status": "completed", "tag": "55fca74a-4596-432e-a05f-27d0507f84b7"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:06.392352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b01f6f58-9b5c-4a1c-8473-13cec93cfad8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.459941 Sep 01 13:55:06.393655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 57/105] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:05 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:06.398188 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:06.398705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:06.399135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:06.417920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] Creating event network-vif-plugged:55fca74a-4596-432e-a05f-27d0507f84b7 for instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 on hv-cinder-83976 Sep 01 13:55:06.423145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-7fb712bf-2c0c-4658-8fb9-b433959f5b8f req-1b529d47-42b5-4aa9-91fa-4b6c59aecc3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048721 Sep 01 13:55:06.424439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 49/106] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:06.956579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:06.957960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:06.961144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:06.976831 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:06.977766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:06.978348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:06.979243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:06.979838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:06.980684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:07.194387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:07.196018 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:07.203172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:07.203706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:07.204172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:07.205078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:07.205527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:07.206123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:07.248142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:07.257100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-496c217b-e0f8-449a-a25e-a71f2c50084d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.306020 Sep 01 13:55:07.257691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 58/107] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:06 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:07.382674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:07.391006 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-40cd2e8c-6cd1-44d0-b8b5-3e66dc547fbc tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1321 microversion: 2.1 time: 0.200896 Sep 01 13:55:07.410938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 50/108] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:07 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:07.415816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:07.416225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:07.425099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:07.425863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:07.426485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:07.428022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:07.428476 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:07.428956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:07.728014 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:07.733872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:07.744606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-50fcf148-20b9-4ddd-974b-7dca00017f30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.331344 Sep 01 13:55:07.745557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 59/109] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:07 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:08.281590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:08.282656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:08.295139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.295139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.295139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.295139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.295605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.295605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.416250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:08.418582 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:08.426841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.427984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.428666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.429684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.430345 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.430977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.452166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:08.462331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-245612ab-1e84-42a1-acc0-700f2d09dd1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.186558 Sep 01 13:55:08.476936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 51/110] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:08 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:08.491342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a22d8a7-f4bf-464d-9328-25d174ce84d8", "name": "network-vif-plugged", "status": "completed", "tag": "ff817d23-cdea-4bcb-8e2e-d93179571285"}, {"server_uuid": "4925f2c9-4e1b-4fdb-bbc1-bb409727546d", "name": "network-vif-plugged", "status": "completed", "tag": "e211de0e-0032-40b9-9347-9565351509d2"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:08.502640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.503770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.504269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.522137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Creating event network-vif-plugged:ff817d23-cdea-4bcb-8e2e-d93179571285 for instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 on hv-cinder-83976 Sep 01 13:55:08.522648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] Creating event network-vif-plugged:e211de0e-0032-40b9-9347-9565351509d2 for instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d on hv-cinder-83976 Sep 01 13:55:08.529496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-d3ab16d5-ad28-452d-b513-0956e740314e req-53a1a544-12de-4db5-95d3-d70d74ef5c82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041965 Sep 01 13:55:08.530304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 52/111] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:08.588776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:08.593039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-254d3712-70c8-4010-bb82-573616b45166 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1515 microversion: 2.1 time: 0.184639 Sep 01 13:55:08.593783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 60/112] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:08 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:08.618805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:08.622870 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:08.632153 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.632657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.633105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.633808 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.634499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.634951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.702199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'flavor' on Instance uuid 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:55:08.768832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:08.769437 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:08.775656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.777516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.777516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.777516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:08.777769 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:08.778151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:08.944591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:08.954250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b2a8d14f-009f-4e8f-a802-cbaf1e03e95e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.189217 Sep 01 13:55:08.954915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 61/113] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:08 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:09.139447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5b3fc0b4-fa0d-4a62-a009-6b0f9d835ace tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7/action" status: 200 len: 32 microversion: 2.1 time: 0.526704 Sep 01 13:55:09.140056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 53/114] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:55:08 2022] POST /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7/action => generated 32 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 13:55:09.150015 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:09.150595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:09.157699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.158547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.159325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:09.160049 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.160692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.161327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:09.306966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:09.316156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b4761c2c-f204-4e8c-a7a1-ef29a6e89133 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.169695 Sep 01 13:55:09.327471 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 62/115] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:09 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:09.485553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:09.486452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:09.494861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.495387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.495838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:09.496551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.497013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.497441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:09.670163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:09.681612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f8869054-8ca5-4092-b1f6-de1e3f6ff9c0 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.200548 Sep 01 13:55:09.683481 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 54/116] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:09 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:09.981985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:09.982739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:09.990518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.991219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.991899 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:09.992774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:09.993452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:09.994189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:10.193830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:10.197441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6d5808c4-1196-4b98-a66b-c95cf1f62a9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.220755 Sep 01 13:55:10.198023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 63/117] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:09 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:10.338497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:10.339271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:10.346900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:10.347480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:10.348227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:10.348978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:10.349437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:10.350123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:10.450964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:10.582194 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:10.590641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-acee2ca3-7ea9-4e4b-b1e6-07f1ae2c8fe5 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.256709 Sep 01 13:55:10.591236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 55/118] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:10 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:10.704852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:10.705561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:10.713155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:10.713760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:10.714260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:10.715068 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:10.715689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:10.716332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:10.907091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:10.915972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-74156484-28f4-4acc-a5b7-da35141fa70b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.215408 Sep 01 13:55:10.917021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 64/119] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:10 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:11.231156 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:11.234103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:11.264829 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.267792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.268510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:11.271790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.272622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.273495 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:11.579979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:11.590135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d7b3cf19-dc60-4a8d-9264-6adf72ca2f4a tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.368525 Sep 01 13:55:11.590747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 56/120] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:11 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:11.622444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:11.623350 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:11.644107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.644625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.645646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:11.662995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.663664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.666730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:11.884422 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:11.898450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-581dbcac-2322-4ac3-adfc-a8c98d2fb036 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.280470 Sep 01 13:55:11.909841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 65/121] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:11 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:11.937853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:11.938530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:11.946114 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.947163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.947910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:11.949979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:11.950725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:11.951880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:12.610801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:12.618120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:12.618841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:12.620005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-eea9dc47-5dfc-4b0f-a846-18b177c6746e tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.686732 Sep 01 13:55:12.632951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 57/122] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:11 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:12.642833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:12.643331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:12.648400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:12.649579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:12.650299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:12.651831 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:12.883622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:12.889675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4528e35b-7a5a-4399-a2c9-cb73773432c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.275612 Sep 01 13:55:12.890460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 66/123] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:12 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:12.930499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:12.931114 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:12.937672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:12.938157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:12.938602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:12.939325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:12.939804 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:12.940229 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:13.354201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:13.364950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ac470408-55cf-43a0-b8f1-321667fcbf4b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.438147 Sep 01 13:55:13.365548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 58/124] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:12 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:13.645060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:13.646372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:13.654606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:13.655275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:13.655962 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:13.656829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:13.657424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:13.658009 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:13.891761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:13.916880 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7f17a865-567e-4b02-9da3-1655e760ea2a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.276042 Sep 01 13:55:13.918067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 67/125] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:13 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:13.929934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:13.930555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:13.949616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:13.950122 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:13.950569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:13.951310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:13.951799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:13.952224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:14.259858 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:14.269616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-647b1036-3965-49f5-84bf-429610796dc8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.353003 Sep 01 13:55:14.270217 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 59/126] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:13 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:14.386971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:14.387776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:14.394596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:14.395203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:14.395761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:14.396712 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:14.397217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:14.397630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:14.553732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:14.562566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e7e217fd-8d89-45a3-a9a4-baa27c9eb4d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.180166 Sep 01 13:55:14.563148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 68/127] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:14 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:14.943542 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:14.944154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:14.950373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:14.951834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:14.952581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:14.953810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:14.954462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:14.955076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:15.120553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:15.129363 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ff4aa2bc-b0eb-41c1-afea-1e0dcd51b013 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.189951 Sep 01 13:55:15.135256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 60/128] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:14 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:15.295340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:15.296101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:15.302376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:15.302928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:15.303490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:15.304186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:15.304631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:15.305219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:15.538198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:15.543762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8ab6cb04-6846-4dd7-a227-d6441bc72fd8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.253101 Sep 01 13:55:15.546482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 69/129] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:15 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:15.584755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:15.585792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:15.593300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:15.594167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:15.594988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:15.595873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:15.596541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:15.597300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:15.879389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:15.895105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c581650c-8443-4350-ab52-fce4e19f953b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.314785 Sep 01 13:55:15.897086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 61/130] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:15 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:16.164109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:16.165763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:16.179183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.179818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.180303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:16.181787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.182325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.182793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:16.468866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:16.478109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-18b45bf8-6cb6-43eb-87eb-c7183c28288d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.325786 Sep 01 13:55:16.478900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 70/131] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:16 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:16.566992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:16.567554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:16.575205 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.575691 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.577673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:16.578836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.579489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.579936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:16.781103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:16.789543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-eda1c64a-c1e2-4565-96a0-33195bf0ecd9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.226792 Sep 01 13:55:16.790645 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 62/132] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:16 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:16.917169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:16.917785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:16.925175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.925667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.926094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:16.926801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:16.927250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:16.927859 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:17.193699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:17.203222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-583acae5-1071-48d0-a5e4-e86edebbc154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.289782 Sep 01 13:55:17.203888 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 71/133] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:16 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:17.499968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.500934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:17.507716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:17.508421 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:17.508842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:17.509685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:17.510277 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:17.510958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:17.724011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:17.728609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:17.734415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0d992e07-1926-405d-a77e-92b27deee2ef tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.238604 Sep 01 13:55:17.735696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 63/134] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:17.811562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.812202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:17.818422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:17.818959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:17.837096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:17.837096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:17.837096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:17.837096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:17.929231 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b71071db-145c-452f-811d-cc5f95b25f73 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Action: 'create', calling method: .version_select at 0x7f980efd0280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1817013721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvTIUFRyR0QUsIQh0WKfYd4ESnfn4BCPzCU3kHhLMNjcsww/7br5Q+MNr8ZycH0wl71j46E38CSWKSpFhyOvH0spmBa6VJv2AOcW7HizclJaFWA2zfyM88C5g1OM11RwA=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:17.960275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-b71071db-145c-452f-811d-cc5f95b25f73 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Getting quotas for project 872714a31bdf46ddad040f1bc4b659da. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:55:17.965517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-b71071db-145c-452f-811d-cc5f95b25f73 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Getting quotas for user 3043eb81894f4525ac2d153da8bd3e2d and project 872714a31bdf46ddad040f1bc4b659da. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:55:18.025074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:18.033220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-586ac23c-ef79-43e6-a772-6a946c621b8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.225578 Sep 01 13:55:18.033815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 64/135] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:18.100379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b71071db-145c-452f-811d-cc5f95b25f73 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.400802 Sep 01 13:55:18.101016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 72/136] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 13:55:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:55:18.224865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:18.226015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:18.237193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:18.239580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:18.240138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:18.243305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:18.244044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:18.245025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:18.396695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:18.405792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-20dae767-494c-4778-bf69-496f7aff7288 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.184891 Sep 01 13:55:18.406682 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 65/137] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:18 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:18.760319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:18.760922 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:18.768163 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:18.768893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:18.769324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:18.770021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:18.770468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:18.770889 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:18.935439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:18.945707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f3cd9f85-bdb0-4c7e-a28d-489e5522e448 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.193306 Sep 01 13:55:18.961472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 73/138] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:18 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:19.054225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:19.054847 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:19.061926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.062648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.063551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:19.064425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.065184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.065751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:19.260976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:19.269036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bd4729fb-f263-442b-b5a0-9ef361ae4231 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1364 microversion: 2.1 time: 0.218541 Sep 01 13:55:19.281268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 66/139] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:19 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:19.430789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:19.431677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:19.438881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.439848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.440726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:19.441715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.442508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.443504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:19.706362 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:19.714308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9c6effef-5010-429b-8ff0-798f6cd8550b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.290351 Sep 01 13:55:19.714876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 74/140] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:19 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:19.973706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:19.973706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:19.980239 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.980736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.981317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:19.981898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:19.982346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:19.982819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.275943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:20.284179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b34f3b14-2220-4f98-b1b0-5bffd86117a7 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.315615 Sep 01 13:55:20.298375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:20.304492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:20.304655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 67/141] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:19 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:20.308341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.309129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.309575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.311151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.311905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.312546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.644045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:20.655332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2ad541be-d640-4ab5-b7b6-8384a048884b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1549 microversion: 2.1 time: 0.361808 Sep 01 13:55:20.656221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 75/142] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:20 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1549 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:20.678934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:20.680000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:20.689453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.690135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.690716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.691623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.692234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.692851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.737277 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:20.737904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:20.750470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.753138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.753138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.753138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:20.754296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:20.754743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:20.799758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8655a289-463b-41dd-9103-b1c215bd3a0b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124237 Sep 01 13:55:20.801001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 68/143] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 13:55:20 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:20.968115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:20.982219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f8615441-9162-46af-914b-1676f9e9931b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.248585 Sep 01 13:55:20.983901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 76/144] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:20 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:21.305361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:21.305977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:21.313931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:21.314650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:21.315337 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:21.316461 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:21.317069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:21.317984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:21.953811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:21.962509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7edc0a17-325a-4e2b-a7b0-2afb15e1a98a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.661581 Sep 01 13:55:21.963083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 69/145] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:21 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:22.003653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:22.004266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:22.010666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:22.011161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:22.011633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:22.012333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:22.012810 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:22.013956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:22.034305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:22.185067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:22.195055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0fa2d0a2-8915-4549-b133-9c8fa665881b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.195189 Sep 01 13:55:22.196005 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 77/146] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:21 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:22.679593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4925f2c9-4e1b-4fdb-bbc1-bb409727546d", "tag": "e211de0e-0032-40b9-9347-9565351509d2"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:22.690985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:22.691720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:22.692229 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:22.707110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] Creating event network-changed:e211de0e-0032-40b9-9347-9565351509d2 for instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d on hv-cinder-83976 Sep 01 13:55:22.714060 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-cc9c26bb-39ec-4691-86a6-faf4375ff699 req-ebfd4b7e-3673-485c-a0d2-477cb7d97541 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038200 Sep 01 13:55:22.715093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 70/147] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:22.985935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:22.986738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:22.994497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:22.995078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:22.995968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:22.996398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:22.997098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:22.998044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:23.219222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:23.219850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:23.233750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:23.234248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:23.238551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:23.238551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:23.238551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:23.238551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:23.369739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:23.379163 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-bfe76af2-0fcb-4f9a-898a-2c569ec787d5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1315 microversion: 2.1 time: 0.398452 Sep 01 13:55:23.381643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 78/148] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:22 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:23.577255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:23.598000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-957d8797-7179-40ce-a297-ad1166cb2c64 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.384753 Sep 01 13:55:23.602893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 71/149] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:23 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:24.402255 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:24.402877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:24.409971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:24.410471 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:24.410915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:24.411658 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:24.412352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:24.412614 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:24.554800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:24.563855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9b040f91-1407-46e9-a4f5-80a19e9864bf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1503 microversion: 2.1 time: 0.165521 Sep 01 13:55:24.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 79/150] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:24 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:24.623187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:24.623882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:24.631223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:24.631927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:24.632588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:24.633243 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:24.633815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:24.634415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:24.867512 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:24.877329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-caede2d4-535f-4109-9d5e-60750f2f3e0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.257969 Sep 01 13:55:24.878597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 72/151] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:24 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:25.900499 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:25.901257 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:25.907141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:25.907649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:25.908071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:25.908855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:25.909327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:25.909766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:26.046407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:26.054515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-abf57f94-789b-41ce-bbf5-1fd1b9e3273a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.158111 Sep 01 13:55:26.055100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 80/152] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:25 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:27.076663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:27.077435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:27.086192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:27.087739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:27.087739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:27.088030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:27.088482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:27.088902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:27.221138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:27.229028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-aa954798-fef5-4587-9cc7-49f6d4cb76f2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.156397 Sep 01 13:55:27.229603 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 73/153] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:27 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:28.250718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:28.251430 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:28.253326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.258545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:28.259025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:28.259494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:28.260192 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:28.260641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:28.261058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:28.394089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:28.401857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f0e1822a-d327-4482-a8b4-112b8a59b6b6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.154978 Sep 01 13:55:28.402921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 81/154] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:28 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:29.423222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:29.423956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:29.426040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=72 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.430915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:29.431416 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:29.431847 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:29.432546 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:29.432987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:29.433405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:29.570946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:29.578839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-119221dd-c872-4a9b-97c5-dfccc7701d28 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.159457 Sep 01 13:55:29.580874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 74/155] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:29 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:30.601171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:30.601924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:30.604039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:30.610271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:30.611236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:30.611717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:30.612475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:30.613196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:30.613785 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:30.775737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:30.786383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-abb87706-64f1-413d-b31a-e2911ab575a2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.187678 Sep 01 13:55:30.786383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 82/156] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:30 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:30.998219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "920ae993-a2ec-4bb6-a7b1-4e0f903a4fc4"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:31.003587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:31.016116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:31.016859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:31.020015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:31.020015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:31.020015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:31.020015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:31.810406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:31.811177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:31.819795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:31.819795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:31.819795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:31.819795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:31.820779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:31.820779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:31.915164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-92695dd5-b350-437c-bdab-5de16d760baf tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "POST /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924421 Sep 01 13:55:31.915899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 75/157] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:55:30 2022] POST /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:31.978289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:31.995566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2b6e300c-2acc-4fa5-868f-eb2d6cb66d82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.190060 Sep 01 13:55:31.997592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 83/158] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:31 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:33.030806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:33.031602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:33.038137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:33.038683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:33.039117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:33.039855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:33.040305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:33.040724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:33.198228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:33.200387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bdb5e1e5-db1c-44b4-90b4-3454989cd8ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.175032 Sep 01 13:55:33.212695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 76/159] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:33 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:34.234216 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:34.234841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:34.242458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:34.246485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:34.246485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:34.246485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:34.246485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:34.247436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:34.424158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:34.431874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5f547b28-6238-4475-8ba8-3ccab302a996 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.214156 Sep 01 13:55:34.433326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 84/160] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:34 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:35.454204 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:35.454833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:35.467209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:35.467732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:35.468172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:35.468902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:35.469338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:35.469771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:35.611346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:35.619588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-718d34e1-dc98-49c3-ba50-3ff62e8c6b6f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.169507 Sep 01 13:55:35.621275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 77/161] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:35 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:36.641150 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:36.641670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:36.648026 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:36.648512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:36.648946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:36.649669 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:36.650119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:36.650541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:36.787443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:36.795390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0fb17bc5-dab6-4c64-9168-4d54b7df86b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.158074 Sep 01 13:55:36.795967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 85/162] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:36 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:37.816610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:37.817147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:37.824055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:37.825043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:37.825474 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:37.826183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:37.826733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:37.827053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:37.965307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:37.973853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-70988df3-f27d-42cf-98ad-e005c6100c08 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.161097 Sep 01 13:55:37.974840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 78/163] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:37 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:38.996923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:38.998453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:39.005034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:39.005523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:39.006169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:39.006855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:39.007306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:39.007738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:39.148133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:39.157167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-787f2934-eb6d-43a7-874d-5a9727e2cbcb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.164873 Sep 01 13:55:39.157805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 86/164] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:38 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:40.183536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:40.184581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:40.195704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:40.196466 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:40.197054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:40.198026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:40.198769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:40.200109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:40.362564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:40.379464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ba174cd6-d6e0-4aee-8047-6c17df234ef1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.202089 Sep 01 13:55:40.399008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 79/165] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:40 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:41.406164 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:41.406807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:41.412842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:41.413324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:41.413758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:41.415737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:41.415737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:41.415737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:41.550292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:41.558044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a24b0bbc-a441-4c4c-be12-575a81d0e93a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.156277 Sep 01 13:55:41.558618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 87/166] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:41 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:42.578562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:42.579227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:42.585932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:42.586442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:42.586868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:42.587592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:42.588041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:42.588458 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:42.593221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:42.718168 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:42.726078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c9611017-c005-4209-a9a8-d6b227adbc7a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.151904 Sep 01 13:55:42.726636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 80/167] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:42 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:43.752238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:43.753467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:43.760943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:43.761953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:43.762383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:43.763080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:43.763561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:43.763978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:43.894438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:43.903727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-33e9591d-15c5-41f0-a9f1-f4222adf2be0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.158971 Sep 01 13:55:43.904344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 88/168] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:43 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:44.925309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:44.925898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:44.932536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:44.933016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:44.933943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:44.934632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:44.935079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:44.935533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:45.073177 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:45.081734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6ea33655-7219-4054-a696-a1731f6af630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.160323 Sep 01 13:55:45.082338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 81/169] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:44 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:46.102191 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:46.102799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:46.108899 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:46.109381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:46.110081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:46.110473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:46.110917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:46.111426 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:46.248396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:46.256364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-db13b157-38b2-4df2-bcc1-eaad0eba332e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.158212 Sep 01 13:55:46.256942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 89/170] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:46 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:47.278471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:47.279163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:47.285734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:47.286322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:47.286827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:47.287619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:47.288146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:47.288638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:47.592324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:47.600642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c99428e2-9792-4ca2-8e32-ebe7a11f0d44 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.326015 Sep 01 13:55:47.601298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 82/171] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:47 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:48.624006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:48.624601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:48.630624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:48.631100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:48.631798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:48.632346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:48.632799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:48.633403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:48.773548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:48.781699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-afa873e7-c58f-482d-b4e8-71ee20e67e18 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.161852 Sep 01 13:55:48.782661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 90/172] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:48 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:49.811901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:49.812716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:49.819210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:49.819983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:49.820724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:49.821412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:49.821856 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:49.822268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:49.978651 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:49.987886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-24fcb64f-663f-442e-814e-e9453332229a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.180564 Sep 01 13:55:49.988452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 83/173] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:49 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:50.687346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:50.687955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:50.694480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:50.694957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:50.695402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:50.696403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:50.696847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:50.697264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:50.723416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:55:51.009160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:51.009706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:51.016777 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:51.017248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:51.017671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:51.018352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:51.018861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:51.019272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:51.080816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7564f486-dc44-4194-be02-9b1806a6b0b5 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 204 len: 0 microversion: 2.1 time: 0.397620 Sep 01 13:55:51.081768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 91/174] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:55:50 2022] DELETE /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:55:51.090750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:51.091469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:51.097391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:51.097863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:51.098292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:51.099237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:51.099773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:51.100208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:51.120214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:51.165313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:51.173803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bf78abba-5f3f-4736-9957-3b96e5d39603 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.168787 Sep 01 13:55:51.174404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 84/175] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:51 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:51.248475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:51.257042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3f053f76-d590-4399-8ffc-da315527effd tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1555 microversion: 2.1 time: 0.170629 Sep 01 13:55:51.257686 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 92/176] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:51 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:52.196251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:52.196780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:52.203346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:52.203855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:52.204286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:52.204973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:52.205419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:52.205874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:52.277986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:52.278597 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:52.285624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:52.286110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:52.287474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:52.287474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:52.287872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:52.288121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:52.362975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:52.374583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-da4bc7ca-5fa8-4613-958a-ddd63c73791e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.182038 Sep 01 13:55:52.375213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 85/177] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:52 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:52.443337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:52.451851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e97e8a44-300e-4e81-8cea-9eadeafa1672 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1555 microversion: 2.1 time: 0.177624 Sep 01 13:55:52.452350 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 93/178] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:52 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:53.396478 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:53.397412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:53.407284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:53.408893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:53.411990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:53.413472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:53.414262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:53.418811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:53.474302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:53.475829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:53.486109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:53.488061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:53.488581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:53.490388 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:53.490862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:53.492627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:53.625115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:53.640008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6dcbd790-2a80-4d82-8fb5-6490eaf8c79e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.247368 Sep 01 13:55:53.645884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 86/179] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:53 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:53.717419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:53.727973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-91c68d52-2c17-41ae-a0ac-6664c16adc1b tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1555 microversion: 2.1 time: 0.258403 Sep 01 13:55:53.735399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 94/180] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:53 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:54.671660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:54.672453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:54.678985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:54.679511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:54.679946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:54.680648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:54.681097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:54.681516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:54.752647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:54.753402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:54.759896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:54.760812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:54.762363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:54.768282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:54.768282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:54.768282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:54.898082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:54.908892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c4bf65ed-cca4-49c8-bcb6-441bbc90acc3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.241607 Sep 01 13:55:54.909545 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 87/181] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:54 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:54.928566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:54.937743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6475a8b5-e287-472f-b679-1bd7460f6152 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1513 microversion: 2.1 time: 0.192085 Sep 01 13:55:54.938328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 95/182] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:54 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:54.971322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a22d8a7-f4bf-464d-9328-25d174ce84d8", "name": "network-vif-deleted", "tag": "ff817d23-cdea-4bcb-8e2e-d93179571285"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:55:54.985982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:54.986625 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:54.987068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:55.012105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] Creating event network-vif-deleted:ff817d23-cdea-4bcb-8e2e-d93179571285 for instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 on hv-cinder-83976 Sep 01 13:55:55.018027 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-d9597d8d-a8aa-4faf-989b-a693504a18e4 req-e80af436-5ec5-4765-8062-c4663bbd1546 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049905 Sep 01 13:55:55.019745 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 88/183] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:55.931583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:55.933000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:55.940483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:55.941111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:55.941796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:55.942564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:55.943087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:55.943604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:55.959055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:55.959798 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:55.971218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:55.973528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:55.973528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:55.973528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:55.973528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:55.977305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:56.021722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:56.021722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:56.021722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:56.021722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lazy-loading 'fault' on Instance uuid 2a22d8a7-f4bf-464d-9328-25d174ce84d8 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:55:56.095192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c2ce45096e4fb493314ad3af039724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32099e5371e84253afb8de38c9c06a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:56.108517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c845774f-1593-4433-9b43-50869dcf7846 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 200 len: 1351 microversion: 2.1 time: 0.154001 Sep 01 13:55:56.109687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 89/184] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:55 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:55:56.153575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:56.158735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-16711004-571d-4905-a2bc-7e0a86a58a07 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.231954 Sep 01 13:55:56.159311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 96/185] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:55 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:57.130610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:57.131218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:57.138329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.138808 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.139237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.140000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.140447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.140854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.156639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] HTTP exception thrown: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Request method failure captured: Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 HTTP/1.1 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmWLTzcR-d_g3-5ullv0qZfNpGWhcQSq8jF4Me56PliRayaBquvcivvIyPQpnR0EIWsDaM77YUsLPvPhomFw7kLRtiHVVWbKEJ-JrdukmzUKlgzlHJwymEgWdupszgM9ZWH_U0r1QwKrRckDpurIV1cmsT0NUYXw3GRpkxqsGdOnGs Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:55:57.161342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32099e5371e84253afb8de38c9c06a82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}] Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 90c2ce45096e4fb493314ad3af039724 Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.162769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '2a22d8a7-f4bf-464d-9328-25d174ce84d8'} Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:55:57.163638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.165026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.166354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Returning 404 to user: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:55:57.166354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-018a8e9f-883b-4e17-88b9-e67f0a2e572a tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 404 len: 111 microversion: 2.1 time: 0.036221 Sep 01 13:55:57.166354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 90/186] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:57 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:55:57.208152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:57.211221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:57.216473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.217220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.217824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.218706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.219459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.220041 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.306876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:57.310073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:57.318258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.318838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.319650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.320577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:57.321211 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:57.321697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:57.342778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] HTTP exception thrown: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Request method failure captured: Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8/os-volume_attachments HTTP/1.1 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmWLTzcR-d_g3-5ullv0qZfNpGWhcQSq8jF4Me56PliRayaBquvcivvIyPQpnR0EIWsDaM77YUsLPvPhomFw7kLRtiHVVWbKEJ-JrdukmzUKlgzlHJwymEgWdupszgM9ZWH_U0r1QwKrRckDpurIV1cmsT0NUYXw3GRpkxqsGdOnGs Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:55:57.345154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32099e5371e84253afb8de38c9c06a82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}] Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 90c2ce45096e4fb493314ad3af039724 Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.346328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'server_id': '2a22d8a7-f4bf-464d-9328-25d174ce84d8'} Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:55:57.347007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:57.348496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:57.351053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Returning 404 to user: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:55:57.352213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-17756ee1-4f02-4fb0-946d-438427353e1f tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049388 Sep 01 13:55:57.352853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 91/187] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:55:57 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:55:57.403895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:57.413997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-27307d41-a1e0-4771-8128-deb0e62bad82 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.237547 Sep 01 13:55:57.419707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 97/188] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:57 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:58.440128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:58.440742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:58.449377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.450213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.450948 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.452037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.452688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.453697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.621698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:58.637078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c97c039f-8657-4c2d-8166-88763fa91562 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.200058 Sep 01 13:55:58.638932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 92/189] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:58 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:58.763913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:58.765179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:58.778473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.778473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.778473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.778473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.778757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.778757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.803092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] HTTP exception thrown: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Request method failure captured: Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: DELETE /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 HTTP/1.1 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmWLTzcR-d_g3-5ullv0qZfNpGWhcQSq8jF4Me56PliRayaBquvcivvIyPQpnR0EIWsDaM77YUsLPvPhomFw7kLRtiHVVWbKEJ-JrdukmzUKlgzlHJwymEgWdupszgM9ZWH_U0r1QwKrRckDpurIV1cmsT0NUYXw3GRpkxqsGdOnGs Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:55:58.808905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32099e5371e84253afb8de38c9c06a82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}] Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 90c2ce45096e4fb493314ad3af039724 Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.810050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '2a22d8a7-f4bf-464d-9328-25d174ce84d8'} Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:55:58.810675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.811760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.815073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Returning 404 to user: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:55:58.816172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-64a5002c-9609-4e01-879c-05372ad70f06 tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 404 len: 111 microversion: 2.1 time: 0.056462 Sep 01 13:55:58.816946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 98/190] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:55:58 2022] DELETE /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:55:58.826620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:58.828794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] [instance: 2a22d8a7-f4bf-464d-9328-25d174ce84d8] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:58.838472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.839174 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.844121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.845496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.846249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.849258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.870653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] HTTP exception thrown: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Request method failure captured: Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 HTTP/1.1 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmWLTzcR-d_g3-5ullv0qZfNpGWhcQSq8jF4Me56PliRayaBquvcivvIyPQpnR0EIWsDaM77YUsLPvPhomFw7kLRtiHVVWbKEJ-JrdukmzUKlgzlHJwymEgWdupszgM9ZWH_U0r1QwKrRckDpurIV1cmsT0NUYXw3GRpkxqsGdOnGs Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:55:58.872915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32099e5371e84253afb8de38c9c06a82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32099e5371e84253afb8de38c9c06a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32099e5371e84253afb8de38c9c06a82"}]}] Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 32099e5371e84253afb8de38c9c06a82 Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-DeleteServersTestJSON-954695812 Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 90c2ce45096e4fb493314ad3af039724 Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-DeleteServersTestJSON-954695812-project Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.874487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '2a22d8a7-f4bf-464d-9328-25d174ce84d8'} Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:55:58.882827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. Sep 01 13:55:58.884187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:55:58.885324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] Returning 404 to user: Instance 2a22d8a7-f4bf-464d-9328-25d174ce84d8 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:55:58.885324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a6378c5a-2a67-462a-9ae5-5d9a91f85b6d tempest-DeleteServersTestJSON-954695812 tempest-DeleteServersTestJSON-954695812-project] 10.222.0.50 "GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8" status: 404 len: 111 microversion: 2.1 time: 0.053869 Sep 01 13:55:58.885324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 93/191] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:58 2022] GET /compute/v2.1/servers/2a22d8a7-f4bf-464d-9328-25d174ce84d8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 13:55:59.662680 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:59.663306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:55:59.673743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:59.674051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:59.674692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:59.675594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:59.676185 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:59.677036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:59.955404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:55:59.968529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f224a660-c534-488f-a210-ad590809e219 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1521 microversion: 2.1 time: 0.310042 Sep 01 13:55:59.969273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 99/192] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:55:59 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:00.991349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:00.992077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:00.998230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=42 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:01.000166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:01.000652 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:01.001092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:01.001800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:01.002372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:01.002798 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:01.246886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:01.258734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4f6d81e9-70f3-4c00-b872-75b082353547 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1501 microversion: 2.1 time: 0.270763 Sep 01 13:56:01.259812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 94/193] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:00 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:01.294457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:01.295968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:01.313965 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:01.315233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:01.316575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:01.317739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:01.318352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:01.318945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:01.553605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:01.564333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4e94a02b-47f2-414b-9f61-753e548bf6d2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1514 microversion: 2.1 time: 0.277891 Sep 01 13:56:01.565507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 100/194] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:01 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:03.650493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:03.656208 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:03.666005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:03.666847 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:03.667704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:03.668593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:03.669209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:03.669933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:03.708432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'flavor' on Instance uuid 9f03e0d8-29d4-41d8-9275-86fb779cab41 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:56:04.124105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8c98cf04-c419-4430-8c15-b89d866ada69 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/action" status: 200 len: 32 microversion: 2.1 time: 0.479086 Sep 01 13:56:04.127207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 95/195] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:56:03 2022] POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/action => generated 32 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 13:56:04.137972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:04.140055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:04.154561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:04.167881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:04.170117 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:04.170837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:04.177110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:04.177110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:04.177110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:04.383944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:04.394440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-76cb5d5c-a30c-409a-929d-a043e88d6fa4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.261424 Sep 01 13:56:04.397273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 101/196] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:04 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:04.527792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1309296551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1817013721", "security_groups": [{"name": "tempest-secgroup-smoke-1664941702"}], "networks": [{"uuid": "cf8ecd2b-c677-42d7-bc89-3e1f7928c2e7"}], "block_device_mapping_v2": [{"uuid": "ca11092e-17af-426e-b911-b91e75e7584e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:04.736708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] validate_networks() for [('cf8ecd2b-c677-42d7-bc89-3e1f7928c2e7', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:56:05.298629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:56:05.299063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:56:05.299596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:56:05.300202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:56:05.300613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:56:05.311557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:05.311910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:05.312332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:05.313139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:05.313604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:05.314034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:05.336765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Getting quotas for project 872714a31bdf46ddad040f1bc4b659da. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:05.342046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Getting quotas for user 3043eb81894f4525ac2d153da8bd3e2d and project 872714a31bdf46ddad040f1bc4b659da. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:05.414727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:56:05.421066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:05.421678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:05.425215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca11092e-17af-426e-b911-b91e75e7584e',volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:56:05.436333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:05.437166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:05.438191 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:05.439247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:05.443764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:05.443764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:05.613046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:05.621844 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a4934c80-5cb1-4746-9e86-42d940ce5ede tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.205303 Sep 01 13:56:05.622641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 102/197] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:05 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:06.027667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-624455c4-d67e-4dad-80ff-5f882c14bcb9 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.504728 Sep 01 13:56:06.028371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 96/198] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:56:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:56:06.039824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-001afcea-cfaa-417e-973e-408bc21ea8e0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:06.040842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-001afcea-cfaa-417e-973e-408bc21ea8e0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:06.098369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-001afcea-cfaa-417e-973e-408bc21ea8e0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:06.105921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-001afcea-cfaa-417e-973e-408bc21ea8e0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1089 microversion: 2.1 time: 0.070369 Sep 01 13:56:06.106817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 103/199] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:06 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:06.650104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:06.651809 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:06.662329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:06.664176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:06.665216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:06.668186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:06.673961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:06.673961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:06.883860 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:06.889635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:06.898427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7dbcc09e-73a9-4dcd-9ccb-4d56b2b15e8a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.257681 Sep 01 13:56:06.901729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 97/200] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:06 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:07.127447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-367a92e4-54ec-4da3-8431-571840269bee tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:07.128267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-367a92e4-54ec-4da3-8431-571840269bee tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:07.190572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-367a92e4-54ec-4da3-8431-571840269bee tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:07.201162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-367a92e4-54ec-4da3-8431-571840269bee tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1089 microversion: 2.1 time: 0.077767 Sep 01 13:56:07.202545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 104/201] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:07 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:07.925025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:07.925623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:07.933791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:07.934290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:07.934927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:07.935491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:07.935949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:07.936373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:08.141975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:08.152007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f180bda4-ec30-4ac6-a4cc-f48961553ebf tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.230906 Sep 01 13:56:08.152920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 98/202] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:07 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:08.229717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:08.230336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:08.239193 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:08.239862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:08.240369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:08.241144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:08.242505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:08.243010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:08.319302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:08.328081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6628a5f1-2018-44c5-aa4c-372977247c77 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1139 microversion: 2.1 time: 0.107803 Sep 01 13:56:08.329937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 105/203] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:08 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:09.177782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:09.178396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:09.187460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:09.188805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:09.189398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:09.190255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:09.190848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:09.191441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:09.350551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:09.350551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:09.360702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:09.362122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:09.363184 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:09.364605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:09.365305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:09.365938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:09.403610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:09.416560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7ae469bc-d922-4ea1-b9e5-aa80cc005154 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.242295 Sep 01 13:56:09.417626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 99/204] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:09 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:09.445612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:09.454344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8a0fd4ac-462e-40a0-a50f-d43cadddc056 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1139 microversion: 2.1 time: 0.108990 Sep 01 13:56:09.454924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 106/205] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:09 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:10.438172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:10.438781 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:10.447288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:10.447806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:10.448241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:10.448940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:10.449434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:10.449857 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:10.475731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:10.477064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:10.493404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:10.495275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:10.495861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:10.498028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:10.498770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:10.500385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:10.576226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:10.585038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4904bb0d-8f06-41ae-b5b5-428e3c06a20a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1131 microversion: 2.1 time: 0.113217 Sep 01 13:56:10.585841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 107/206] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:10 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1131 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:10.641066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:10.663087 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0890c364-0cb8-44fb-bb1c-98767533b997 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.228449 Sep 01 13:56:10.664270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 100/207] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:10 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:11.606551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:11.607866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:11.615018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:11.615666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:11.616195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:11.617146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:11.617694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:11.618214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:11.686471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:11.692637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:11.699106 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:11.699629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:11.700068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:11.700784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:11.701243 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:11.701668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:11.717135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:11.727453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9ee380b6-5ec5-4135-8ccd-da94834d10eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1187 microversion: 2.1 time: 0.123427 Sep 01 13:56:11.727453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 108/208] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:11 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:12.066013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:12.079518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e540bfd3-f7aa-4488-8876-4c66aa530819 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.397330 Sep 01 13:56:12.087012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 101/209] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:11 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:12.749463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:12.750656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:12.756987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:12.757700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:12.758312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:12.759224 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:12.759867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:12.760438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:12.836537 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:12.851245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d7330a60-9c97-4471-93c9-ae22fd0efda1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1205 microversion: 2.1 time: 0.104247 Sep 01 13:56:12.853450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 109/210] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:12 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1205 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:13.110061 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:13.110684 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:13.118535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:13.119253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:13.120378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:13.121115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:13.121569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:13.121985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:13.878540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:13.879275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:13.884189 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:13.890928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:13.891457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:13.892431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:13.893493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:13.894127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:13.894552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:13.897295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-934a3bc5-8b5b-409e-a3ee-a35b5b8c027a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.791005 Sep 01 13:56:13.898340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 102/211] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:13 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:14.082042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:14.091633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d80ea36e-7593-4500-b9ed-0533a051b301 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.220651 Sep 01 13:56:14.092225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 110/212] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:13 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:14.921085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:14.921845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:14.928408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:14.928889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:14.929316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:14.930009 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:14.930455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:14.930870 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:15.081947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:15.091298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0b25bdee-fbc0-4e32-8997-7f50594d1de0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.174632 Sep 01 13:56:15.092138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 103/213] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:14 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:15.112534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:15.113246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:15.119284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:15.119940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:15.120439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:15.121207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:15.121726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:15.122226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:15.177985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-307928d8-fd33-41c5-8d87-edd463867843 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: .version_select at 0x7f980edfe3a0>, body: {"keypair": {"name": "tempest-keypair-2062572916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5+ME8750fi/ghdogmmzOQLrYrC/B3A3whvvEty6w7WCOrVvkwjk0HbxJaBnzl41qrBH8PTFliWp/15+zqhC6147vwPKCvhBieCorQPiAepXyykHkPNI0k8Y3/ECkIt9A=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:15.194056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-307928d8-fd33-41c5-8d87-edd463867843 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:15.198064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-307928d8-fd33-41c5-8d87-edd463867843 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for user 658108c26fb74eba911e249819f8b290 and project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:15.268616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:15.279038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5b783321-1ceb-4efa-bdcb-4f93845437eb tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.169519 Sep 01 13:56:15.281059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 104/214] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:15 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:15.301477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-307928d8-fd33-41c5-8d87-edd463867843 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.249176 Sep 01 13:56:15.302202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 111/215] 10.222.0.50 () {62 vars in 1200 bytes} [Thu Sep 1 13:56:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 13:56:16.113774 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:16.114588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:16.117641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:16.118781 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:16.122984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:16.123506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:16.123946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:16.124697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:16.125187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:16.126033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:16.293328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:16.301583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:16.302118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0832d364-ca92-456b-bd0b-ed816f2b925c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.191889 Sep 01 13:56:16.302465 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:16.302607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 105/216] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:16 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:16.310866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:16.311538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:16.312169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:16.312913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:16.313425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:16.313903 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:16.533335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:16.539023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:16.552684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-09188d90-18bb-4a44-9fc4-c5000b402888 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.250702 Sep 01 13:56:16.553458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 112/217] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:16 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:16.747250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:16.765765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:16.766289 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:16.767066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:16.779653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] Creating event network-changed:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 13:56:16.785376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-da10af4c-7f22-4242-891d-18e31618cd21 req-974fdf29-fa71-404d-a03d-00ac07666daf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042331 Sep 01 13:56:16.786408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 106/218] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:17.326198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:17.327596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:17.333449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:17.334241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:17.334741 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:17.335617 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:17.336069 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:17.336491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:17.493354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:17.503765 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-017637dd-b51e-4b38-93c4-6695a883a720 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.183469 Sep 01 13:56:17.504352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 113/219] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:17 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:17.575391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:17.576093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:17.583123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:17.583640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:17.584123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:17.584833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:17.585286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:17.585706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:17.828859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:17.842356 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ecbbc9c6-e0be-4309-817c-20212de86ff6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.272398 Sep 01 13:56:17.843531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 107/220] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:17 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:18.288999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1646284885", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4da6191a-4859-4f2e-959b-f5552b48d48b"}], "security_groups": [{"name": "tempest-securitygroup--135671756"}], "key_name": "tempest-keypair-2062572916", "user_data": "}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:18.397148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] validate_networks() for [('4da6191a-4859-4f2e-959b-f5552b48d48b', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:56:18.524925 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:18.525535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:18.531653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.532132 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.532557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.533244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.533690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.534104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.670453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:18.679030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ae485139-f138-47c7-b0a7-61bf9fbff49c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.157996 Sep 01 13:56:18.679873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 108/221] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:18 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:18.784592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:56:18.785431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:56:18.786167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:56:18.786936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:56:18.787494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:56:18.797466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.797941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.798366 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.799077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.804167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.804167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.816914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:18.822524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for user 658108c26fb74eba911e249819f8b290 and project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:18.836353 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:56:18.839500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:56:18.870304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:18.871984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:18.878698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.879176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.879628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.880375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:18.880817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:18.881236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:18.966729 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1600ecac-81be-4eb5-9868-3e5541818edb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.682270 Sep 01 13:56:18.967716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 114/222] 10.222.0.50 () {62 vars in 1188 bytes} [Thu Sep 1 13:56:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 13:56:18.978688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:18.980207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:19.032778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:19.041025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-72e7bc24-e1db-4f3d-bb6d-a37133cc8353 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.175996 Sep 01 13:56:19.051731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 109/223] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:18 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:19.096008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:19.104168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:19.105548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:19.106867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f95cb302-76a0-47e2-90ec-fc4ed8f0a11b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1282 microversion: 2.20 time: 0.132006 Sep 01 13:56:19.107821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 115/224] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:18 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:19.700800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:19.701510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:19.711394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:19.712237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:19.720967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:19.720967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:19.720967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:19.720967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:19.982386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:19.990669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e7386172-b7fa-4945-aad3-5d51a27ba2b9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.293976 Sep 01 13:56:19.992602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 110/225] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:19 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:20.063995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:20.065051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:20.075536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:20.076386 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:20.077274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:20.078180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:20.078946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:20.079795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:20.133033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:20.133733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:20.225736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:20.230048 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:20.233742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:20.235408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:20.236523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4ba05032-b480-4bdc-8805-8f707448a2e5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1282 microversion: 2.20 time: 0.111285 Sep 01 13:56:20.237074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 111/226] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:20 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:56:20.249649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0157026f-3326-44fb-885e-c3dfc3f23967 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.179965 Sep 01 13:56:20.249649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 116/227] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:20 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:21.010732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:21.011251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:21.019136 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.019680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.020219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.021162 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.022804 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.023282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.162155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:21.170759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3f0f4bc6-dead-4146-9e2d-a5f6bc9ee256 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.164101 Sep 01 13:56:21.171331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 112/228] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:21 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:21.260188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:21.261382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:21.261716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:21.262332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:21.267557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.268041 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.268510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.268622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.274102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.274221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.274319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.274402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.274402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.274565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:21.274565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:21.274565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:21.338371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:21.349621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:21.351130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:21.352305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1545bca4-00bc-4090-b084-cde3dc31714b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1278 microversion: 2.20 time: 0.096262 Sep 01 13:56:21.352884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 117/229] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:21 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:21.541659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:21.549731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cc00e019-11ba-46f1-b104-b10c160a91f1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.292257 Sep 01 13:56:21.550311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 113/230] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:21 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:22.191870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:22.192505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:22.198497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.198972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.199467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.200157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.200598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.201019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.340552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:22.349380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1f16a855-d6d1-4ce9-88db-0855f43ea620 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.160854 Sep 01 13:56:22.350507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 118/231] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:22 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:22.375032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:22.375685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:22.382489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.382965 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.383409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.384097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.384547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.384975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.457881 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:22.468938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:22.470817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:22.472946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-db196204-bd72-4cee-83e3-55ae3678a225 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1334 microversion: 2.20 time: 0.101565 Sep 01 13:56:22.474484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 114/232] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:22 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:22.572472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:22.573129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:22.582713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.583583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.583999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.584707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:22.585162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:22.585963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:22.745506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:22.753460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6d6ff00e-8fcf-4707-be38-b4ae81d4fb6e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1273 microversion: 2.1 time: 0.186874 Sep 01 13:56:22.757195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 119/233] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:22 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:23.372634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:23.373473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:23.380899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.382292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.383380 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.384584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.386108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.386984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.502469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:23.503077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:23.519752 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.519752 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.519752 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.524473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.525036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.526302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.642322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:23.650874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:23.652391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:23.653978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ae95d9ee-00cf-4750-821b-ff5a1dfb7775 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1340 microversion: 2.20 time: 0.155683 Sep 01 13:56:23.659841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 120/234] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:23 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:23.728552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:23.737729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-784af690-5fe8-4104-9239-5e7962858886 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.370007 Sep 01 13:56:23.738301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 115/235] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:23 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:23.775476 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:23.776648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:23.784681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.785455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.786103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.787046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:23.787754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:23.788647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:23.947809 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:23.956533 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3f223e31-4d1c-40c7-a559-b96a2f19efd7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.186230 Sep 01 13:56:23.957100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 121/236] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:23 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:24.678510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:24.680109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:24.688514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:24.689297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:24.689957 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:24.691012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:24.691500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:24.692270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:24.696860 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:24.760621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:24.762442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:24.769638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:24.770115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:24.770824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:24.771563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:24.772207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:24.772687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:24.939543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:24.953462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:24.956002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:24.957551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6c3c54fb-a39e-4958-870d-6006b3bd3a53 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.283199 Sep 01 13:56:24.959968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 116/237] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:24 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:56:24.987032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:24.988698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:24.999932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:25.000470 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:25.000835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:25.001530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:25.001978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:25.002411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:25.002544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:25.027692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3c2c6f13-ec4b-4fbd-94be-698e177cec9e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.271946 Sep 01 13:56:25.028282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 122/238] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:24 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:25.276371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:25.286909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dedb5a51-f1f4-463b-9a80-3d78f4e1d9fc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.309703 Sep 01 13:56:25.288013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 117/239] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:24 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:25.539606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:25.549515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:25.549997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:25.550428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:25.567503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] Creating event network-changed:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:56:25.575269 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-decfe4e9-f743-4555-b2a2-b3ddb815f27c req-31ad769d-ebcb-4513-9ae0-56a6e6139259 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039179 Sep 01 13:56:25.576321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 123/240] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:26.099806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:26.099806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:26.099806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.099806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.101207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.101207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.101207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.101207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.101560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:26.101560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:26.101560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.101560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.102699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.102699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.102699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.102699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.126971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:26.136415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:26.138090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:26.139241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3478cffd-9569-41d8-8182-c98258d4ba6b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.161411 Sep 01 13:56:26.140035 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 118/241] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:25 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:26.202237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:26.209931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1c3b1380-9d0b-43cf-873b-87618ce7fe37 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.164418 Sep 01 13:56:26.210506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 124/242] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:26 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:26.309176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:26.309906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:26.315960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.316440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.316879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.317566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:26.318019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:26.318442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:26.460306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:26.468938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6b306b7a-a164-4719-8680-15ba22800979 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.163560 Sep 01 13:56:26.469445 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 119/243] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:26 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:27.162011 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:27.167551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:27.169205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.169678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.170105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.170783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.171220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.171703 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.231703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:27.232316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:27.242021 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.242895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.243725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.244883 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.245727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.246527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.349642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:27.359873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:27.361397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:27.362717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e946e039-dd79-48b0-8d8f-f9c2ca8a2c7f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.204539 Sep 01 13:56:27.365600 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 125/244] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:27 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:56:27.426327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:27.435731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-08d01fce-9051-474c-b546-ccd0f9c66397 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.208357 Sep 01 13:56:27.444705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 120/245] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:27 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:27.490131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:27.490829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:27.497546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.498025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.498455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.499147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:27.499620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:27.500038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:27.638293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:27.646437 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-105155da-26b4-4f16-a694-1cb29538633d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.160129 Sep 01 13:56:27.647115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 126/246] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:27 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:28.388206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:28.389434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:28.396982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.397479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.398069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.399186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.399659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.400077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.457043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:28.457649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:28.464756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.469398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.469398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.469398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.469398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.469761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.536604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:28.545629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:28.547073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:28.548314 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-54ff0a56-c7e8-4f32-a1eb-dbc27dfb44be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.164474 Sep 01 13:56:28.548901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 121/247] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:28 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:28.603307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:28.611823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-90614423-0521-46c0-8b05-b7e2cc2650c8 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.158531 Sep 01 13:56:28.612448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 127/248] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:28 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:28.670628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:28.672262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:28.678422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.678907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.679344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.680070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:28.680527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:28.680950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:28.824392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:28.832129 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-258a2a43-b603-4646-9e0f-5f1b79994f80 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.167521 Sep 01 13:56:28.835988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 122/249] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:28 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:29.570878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:29.571536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:29.573439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:29.574200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=16 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:29.578933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.583798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.583798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:29.583798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.583798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.584272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:29.633593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:29.634203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:29.641059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.641619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.642126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:29.642896 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.643446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.643946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:29.717825 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:29.728452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:29.728452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:29.729801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5b3ca84a-00ce-4dfe-8fb0-fab953e9295b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.162284 Sep 01 13:56:29.730351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 128/250] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:29 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:29.777932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:29.787446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-65488602-2183-4132-a809-ac5b273523be tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.157819 Sep 01 13:56:29.788023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 123/251] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:29 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:29.854763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:29.855384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:29.861291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.861762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.862205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:29.862863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:29.863307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:29.863756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:30.003113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:30.009754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-05d7aab1-f7bf-4c0c-96ea-29633cb224a3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.159179 Sep 01 13:56:30.010327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 129/252] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:29 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:30.752361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:30.753004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:30.754911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:30.760267 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:30.760701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:30.761240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:30.761937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:30.762439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:30.762967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:30.809212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:30.809947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:30.817057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:30.817650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:30.820612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:30.820612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:30.820612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:30.820612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:30.914297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:30.923915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:30.930713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:30.931991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b3839ac9-1e65-400c-96d6-0261cde277a5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.183593 Sep 01 13:56:30.932473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 124/253] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:30 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:30.982018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:30.990519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-df768133-7080-42c7-b92d-cb672976d990 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.185197 Sep 01 13:56:30.991335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 130/254] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:30 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:31.030926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:31.031660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:31.037734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:31.038291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:31.038795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:31.039654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:31.040184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:31.040680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:31.172886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:31.180792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-91e670ca-bd15-4069-bd96-3218db521fb3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.154435 Sep 01 13:56:31.181351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 125/255] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:31 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:31.954361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:31.954973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:31.961077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:31.961558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:31.962041 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:31.962726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:31.963336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:31.963839 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:32.012517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:32.016360 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:32.019134 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:32.019655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:32.020093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:32.020797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:32.021253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:32.021703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:32.108726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:32.112274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:32.118167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:32.119734 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:32.125012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e0181888-ec5d-46b0-8eae-9f70901629ad tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.170856 Sep 01 13:56:32.125012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 131/256] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:31 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:32.162965 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:32.171095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d9b9ddc5-8cb8-4572-97f3-44a4bacd9ad3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.163086 Sep 01 13:56:32.171711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 126/257] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:32 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:32.202615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:32.203225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:32.210035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:32.210525 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:32.210953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:32.211711 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:32.212166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:32.212598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:32.346214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:32.354355 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4cc681c2-bb0a-4593-b599-131a8e987dae tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.156349 Sep 01 13:56:32.354853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 132/258] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:32 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:33.146175 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:33.146875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:33.154374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.155053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.155524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.156238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.156691 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.157115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.194427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:33.195200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:33.216254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.216761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.217183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.217904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.218352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.218780 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.335792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:33.346445 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:33.348224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:33.351399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a763c2b1-4866-4d1b-a0e5-fecd6402d3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.207155 Sep 01 13:56:33.351399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 127/259] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:33 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:33.375554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:33.376171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:33.384523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.385014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.385576 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.386753 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:33.387206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:33.387660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:33.401906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:33.412339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c3f70f23-1c4d-4b10-9945-c6bfd8fa2540 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.223286 Sep 01 13:56:33.414312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 133/260] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:33 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:33.659822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:33.667581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8a00c950-0a8b-4edd-b022-f8f89d3e29b5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.296172 Sep 01 13:56:33.668167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 128/261] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:33 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:34.373774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:34.374446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:34.380953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.381441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.381876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.382579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.383024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.383479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.434316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:34.435845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:34.438675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:34.443677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.444243 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.444744 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.445678 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.446397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.446867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.527593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:34.536081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:34.537965 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:34.539344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9e785aa5-edd3-4734-af67-3747033e28db tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.170845 Sep 01 13:56:34.539933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 134/262] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:34 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:34.658937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:34.668242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-de28443b-63c3-41c0-ae6f-660a98b59951 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.237781 Sep 01 13:56:34.668842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 129/263] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:34 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:34.688252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:34.688857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:34.690732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:34.695588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.696061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.696483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.697159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:34.697762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:34.698175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:34.830990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:34.838799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-34b74a69-e569-45bf-83b5-82cebf0b8ee6 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.154543 Sep 01 13:56:34.840023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 135/264] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:34 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:35.562655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:35.563254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:35.570129 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.570538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.570964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:35.571687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.572131 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.572548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:35.690000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:35.690838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:35.697758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.698305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.698750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:35.702318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.702318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.702318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:35.702731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:35.710671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:35.712315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:35.713420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f229ec5f-e6f2-42c2-ad5f-de08808cde9b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.155316 Sep 01 13:56:35.713974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 130/265] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:35 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:35.829051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:35.836755 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1d440fc1-e72e-4470-a7a8-7a20a469168a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.150632 Sep 01 13:56:35.837330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 136/266] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:35 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:35.860104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:35.860716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:35.866580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.867054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.867523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:35.868202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:35.868645 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:35.869062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:36.007787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:36.016441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f15c7294-8a56-4727-91e6-b60f070551c1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.160088 Sep 01 13:56:36.017031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 131/267] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:35 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:36.736271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:36.736805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:36.742838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:36.743312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:36.743775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:36.744457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:36.744907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:36.745820 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:36.857565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:36.858219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:36.864974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:36.865442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:36.865877 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:36.866589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:36.867093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:36.867500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:36.878319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:36.887424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:36.888880 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:36.889967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e7008fe7-86db-4b15-878d-3b3f76fb2c1d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.157670 Sep 01 13:56:36.890517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 137/268] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:36 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:36.998318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:37.001902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:37.006501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a6177256-6d6a-41cc-8b86-dbe081ff8d51 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.152870 Sep 01 13:56:37.007063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 132/269] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:36 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:37.037706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:37.038322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:37.045469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:37.045948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:37.046370 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:37.047075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:37.047556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:37.048089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:37.194689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:37.212890 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9600758c-7f5b-4fff-98cd-c8f53a8c1bbc tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.179289 Sep 01 13:56:37.213648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 138/270] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:37 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:37.911775 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:37.912413 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:37.920553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:37.921036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:37.921477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:37.925699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:37.925699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:37.925699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:38.027698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:38.028331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:38.034501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:38.034985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:38.035439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:38.036150 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:38.036595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:38.037010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:38.065737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:38.074312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:38.075877 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:38.076921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8157d77b-45f6-406d-9587-1ac952777aa0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.169158 Sep 01 13:56:38.077488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 133/271] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:37 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:38.186071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:38.194928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fcb629a4-8a6b-455e-8191-3d28087023ec tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.171087 Sep 01 13:56:38.207758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 139/272] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:38 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:38.237100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:38.238121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:38.250027 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:38.251783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:38.251783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:38.252785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:38.253282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:38.253716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:38.422244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:38.430300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dcdbc6d7-db0d-4958-a8c1-baa227f015ef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.199337 Sep 01 13:56:38.431015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 134/273] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:38 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:39.099501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:39.100330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.106854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.107343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.107804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.108572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.109016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.109434 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.216839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:39.229249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.229249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.229249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.229249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.230729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.230729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.230729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.250457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.262475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.265199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.266440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-24ffeb49-53dd-4497-83d1-a9af147a454b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.171009 Sep 01 13:56:39.267407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 140/274] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:39 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:39.368874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.377445 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-22767ff0-f24a-45f7-bea8-1627b2af0b8f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1500 microversion: 2.1 time: 0.164546 Sep 01 13:56:39.378040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 135/275] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:39 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:39.398575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2045f8f-43fc-4152-8cda-e7dfb917da44"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:39.404134 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.407053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.407570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.408002 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.408691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.409131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.409545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.434216 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] HTTP exception thrown: Cannot 'attach_volume' instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 while it is in vm_state rescued Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Request method failure captured: Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/os-volume_attachments HTTP/1.1 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 74 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmVaIUV1sZ1FUTBVGQBvgfIMlUjZEa76od2HmAagPN_ZBZ670VhWyVv88yinZkiStz7yP6Z18Y1hZy-dSyapRyaBxqR11xXoSzPS94ieRptpOtYTf3argdr5iRfgG8OVsuicFE9P5Ouv-bLFR-86h9X7d6o9zxYetvfbppnxMztsCw Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:56:39.435895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}] Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5a441adf6eee4ba78992aafbbf02f1c8 Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {"volumeAttachment": {"volumeId": "b2045f8f-43fc-4152-8cda-e7dfb917da44"}} Sep 01 13:56:39.437519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Cannot 'attach_volume' instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 while it is in vm_state rescued Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'server_id': '9f03e0d8-29d4-41d8-9275-86fb779cab41', 'body': {'volumeAttachment': {'volumeId': 'b2045f8f-43fc-4152-8cda-e7dfb917da44'}}} Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:56:39.438481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 while it is in vm_state rescued Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:56:39.450864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 while it is in vm_state rescued Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Returning 409 to user: Cannot 'attach_volume' instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 while it is in vm_state rescued {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f24535de-650f-4c91-9f87-ebbc1197079b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042848 Sep 01 13:56:39.452772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 141/276] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:56:39 2022] POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 13:56:39.453292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:39.453292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.453450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:39.453450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.455082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.456073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.456526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.457234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.457683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.458105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.458802 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.459294 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.461138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.461138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.461987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.462421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.599523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.608575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a0bb3a80-90a1-4558-ae26-5b17afe3b4f4 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.160769 Sep 01 13:56:39.609166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 142/277] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:39 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:39.646614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0ec3e2be-1cb6-486e-9d10-596020368bb4 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/action" status: 202 len: 0 microversion: 2.1 time: 0.203205 Sep 01 13:56:39.647285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 136/278] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:56:39 2022] POST /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:56:39.656283 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:39.657112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:39.666455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.666945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.668300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.673047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:39.673047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:39.673047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:39.808418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:39.817418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-51d8f68f-7e29-4bef-8a5e-9f09e18f9064 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1508 microversion: 2.1 time: 0.165607 Sep 01 13:56:39.819973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 143/279] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:39 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:40.034844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "name": "network-vif-plugged", "status": "completed", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:40.045678 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.046274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.046904 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.062157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] Creating event network-vif-plugged:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 13:56:40.071749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-f30688f5-2e57-426e-8f96-7ecaf11634d3 req-64ed8adb-7b54-47f0-be36-2307150abc8a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041555 Sep 01 13:56:40.072598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 137/280] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:40.297288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:40.298528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:40.306501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.306978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.309304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.309304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.309304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.309304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.640688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:40.641367 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:40.661947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.663741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.664480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.665685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.668111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.671597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.755065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:40.764926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:40.770002 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:40.772026 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ffb26f13-3147-4cfd-b6c7-7c269647fa77 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.479307 Sep 01 13:56:40.773184 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 144/281] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:40 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:56:40.838183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:40.838817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:40.852398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.852884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.853313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.854012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:40.854455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:40.855437 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:40.911238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:40.923192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-41ee6b0a-7e90-40cb-814c-f62e2c6b2e55 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.294591 Sep 01 13:56:40.924309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 138/282] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:40 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:40.987663 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:40.996474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-efa5af93-7157-4d1d-b0a9-80c5883e2ba1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1508 microversion: 2.1 time: 0.161546 Sep 01 13:56:40.997042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 145/283] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:40 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:41.796155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:41.796835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:41.803617 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.804040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.804472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.805164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.805613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.806033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.894913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:41.895504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:41.903166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.903820 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.904270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.904974 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.905416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.919430 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.949639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-987e523a-6d61-4caa-b403-67aa1ca0457d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/ips" status: 200 len: 145 microversion: 2.1 time: 0.061305 Sep 01 13:56:41.956053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 146/284] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 13:56:41 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:41.956053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:41.956053 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:41.960850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:41.961327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.961809 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.962232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.963087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:41.963644 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:41.964135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:41.969353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:41.970861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:41.972019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-550c2a3a-fe94-4105-8ea7-28726137bd52 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.179824 Sep 01 13:56:41.972578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 139/285] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:41 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:42.019943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:42.020557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:42.026682 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:42.027203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:42.027661 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:42.028379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:42.028830 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:42.029255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:42.153209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:42.162898 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-411cc99a-07b1-4f6a-94d8-90568c98e195 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.211629 Sep 01 13:56:42.163767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 147/286] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:41 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:42.202885 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:42.211219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-01469b98-cc71-4884-9e2d-7a7c8432ddf3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1508 microversion: 2.1 time: 0.195009 Sep 01 13:56:42.212042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 140/287] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:42 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:43.006498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:43.007215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:43.018446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.018970 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.019427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.020143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.020667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.021043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.183648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:43.185873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:43.187263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:43.196683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.197183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.197620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.199132 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.199663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.200222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:43.200722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.204691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:43.206136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0b313c3a-6b16-46eb-b40e-5b89acb8c83e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.203636 Sep 01 13:56:43.209489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 148/288] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:43 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:43.237941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:43.239156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:43.255609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.256588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.263010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.264617 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:43.265909 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:43.268574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:43.276188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:43.417187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:43.426242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-960e3b36-995a-4dfa-b2e9-fd34e08f2d05 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1261 microversion: 2.1 time: 0.246014 Sep 01 13:56:43.426845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 141/289] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:43 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:43.517282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:43.531449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dbcb84de-192b-49a7-accf-4c60ebc85210 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1514 microversion: 2.1 time: 0.301891 Sep 01 13:56:43.532497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 149/290] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:43 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:44.134905 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "name": "network-vif-plugged", "status": "completed", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:44.164957 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.165535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.166064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.203030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] Creating event network-vif-plugged:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:56:44.213150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-dd9da315-04b8-45dd-abab-f81f61b17b26 req-7630171e-5d8a-46ef-8db9-af69a67fce81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082011 Sep 01 13:56:44.213758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 142/291] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:44.233280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:44.234001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:44.243217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.243852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.244392 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.245583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.246216 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.247102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.448120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:44.449108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:44.456117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.456921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.457535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.458427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.459078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.459525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.512087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:44.527294 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:44.530684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:44.532787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3fce7c06-8b2e-4b93-bed0-2eacfa2cff64 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.304854 Sep 01 13:56:44.533796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 150/292] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:44 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:44.653986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:44.662230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-62c3dbc9-94a4-4c25-87fe-b299a7ec6994 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1446 microversion: 2.1 time: 0.218299 Sep 01 13:56:44.663422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 143/293] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:44 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:44.685535 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:44.690153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:44.692577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.693071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.693507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.694229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:44.694858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:44.695288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:44.930381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:44.940180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f1bc4fe7-1634-49d7-aa88-4daadfe0ef4d tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1446 microversion: 2.1 time: 0.260465 Sep 01 13:56:44.967039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 151/294] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:44 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1446 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:45.189012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98fa65d5-587d-4900-9be1-47a00986ab79"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:45.191444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:45.198347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:45.199515 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:45.200128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:45.200963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:45.201489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:45.205199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:45.398699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-92821a2a-42fe-4978-9a0b-a40ace298630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: .version_select at 0x7f980edfe670>, body: {"keypair": {"name": "tempest-keypair-803366237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsL5hshRmCaj8HZShh2SfJAVOIdQgbEIhc6wOwOoFLyt9x3K3IXCvpMGLS2CuXKZs3Fs1phP6DZxKSQ+3MOAkbWk2WVRSYbb2TMMSXlC6g/CFOmpdZ6+cGom54GJ1/6pA=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:45.432145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-92821a2a-42fe-4978-9a0b-a40ace298630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:45.437340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-92821a2a-42fe-4978-9a0b-a40ace298630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for user 5a441adf6eee4ba78992aafbbf02f1c8 and project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:45.584366 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-92821a2a-42fe-4978-9a0b-a40ace298630 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199350 Sep 01 13:56:45.585003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 152/295] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 13:56:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:45.589940 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:45.590556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:45.597091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:45.597583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:45.598017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:45.598714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:45.599162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:45.599612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:45.925236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:45.936482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:45.939098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:45.940540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b49857a6-be21-4ca8-9702-28141c851198 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1407 microversion: 2.20 time: 0.354594 Sep 01 13:56:45.941263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 153/296] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:45 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:46.495882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c2b4be2a-1eb5-4bea-a4e2-2e90c9c32f8d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.309901 Sep 01 13:56:46.497500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 144/297] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:56:45 2022] POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments => generated 194 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:46.967113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:46.967761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:46.975231 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:46.975666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:46.976290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:46.976844 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:46.977223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:46.977647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:47.177472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:47.186303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:47.187773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:47.188991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0dcc0d9f-3c48-47dd-b51b-c1193abe1e49 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1598 microversion: 2.20 time: 0.226669 Sep 01 13:56:47.189551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 154/298] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:56:46 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1598 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:56:47.217848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:47.218491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:47.225023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:47.225769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:47.226235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:47.226906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:47.227376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:47.227803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:47.320884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-081d1e0d-e74a-4462-829e-8cb64b011bc8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109061 Sep 01 13:56:47.321484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 145/299] 10.222.0.50 () {60 vars in 1316 bytes} [Thu Sep 1 13:56:47 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:56:49.107128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:49.121500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:49.122317 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:49.122774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:49.139351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] Creating event network-changed:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 13:56:49.147456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-1a3421fb-f8be-4fd9-8976-8fd535f09557 req-e6956bdc-ff5c-441a-bd96-33958bc8bb6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046422 Sep 01 13:56:49.150828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 155/300] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:49.351170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1237214043", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cc01e5c-b3f0-4a35-bb32-d14ad308530f"}], "security_groups": [{"name": "tempest-securitygroup--841707232"}], "key_name": "tempest-keypair-803366237", "user_data": "}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:49.672576 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] validate_networks() for [('4cc01e5c-b3f0-4a35-bb32-d14ad308530f', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:56:50.311842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:56:50.312662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:56:50.313371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:56:50.313889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:56:50.314615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:56:50.332288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:50.333244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:50.333746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:50.335174 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:50.335944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:50.336630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:50.390755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:50.404826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Getting quotas for user 5a441adf6eee4ba78992aafbbf02f1c8 and project 2c45ef65901048fe8966f332a04fb6c9. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:50.436178 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:56:50.439155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:56:50.653310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1a327ed8-e87b-43b5-b883-34caba5e970b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.305827 Sep 01 13:56:50.654079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 146/301] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:56:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:56:50.675131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-36967e17-7d5c-4025-8054-36101b9dae19 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:50.675923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-36967e17-7d5c-4025-8054-36101b9dae19 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:50.793006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-36967e17-7d5c-4025-8054-36101b9dae19 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:50.804482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-36967e17-7d5c-4025-8054-36101b9dae19 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1245 microversion: 2.1 time: 0.142055 Sep 01 13:56:50.808544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 156/302] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:50 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:51.172723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:51.184359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:51.185166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:51.185785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:51.198085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] Creating event network-changed:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:56:51.204886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-c7c28c0e-07d2-488f-a52e-6ef9fb0aa118 req-b4583226-45a0-412c-a502-23dc4ba25197 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035709 Sep 01 13:56:51.205734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 147/303] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:51.829335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:51.829967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:51.843668 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:51.845398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:51.846519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:51.847717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:51.848435 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:51.855999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:52.087748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:52.101237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-93138f43-c642-40b4-baf9-fec99a610d2f tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1249 microversion: 2.1 time: 0.276216 Sep 01 13:56:52.102115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 157/304] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:51 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1249 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:52.814878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2022719494", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "networks": [{"uuid": "22bff36b-44e2-4646-bc3f-14a6a3dc66cf"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:52.887555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] validate_networks() for [('22bff36b-44e2-4646-bc3f-14a6a3dc66cf', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:56:53.122630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:53.123278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:53.134801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:53.134801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:53.134801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:53.134801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:53.135331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:53.135331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:53.196099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:53.204143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-65dc1975-9847-433f-b861-7c21cd4e3f30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1297 microversion: 2.1 time: 0.085901 Sep 01 13:56:53.204713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 158/305] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:53 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:53.250385 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:56:53.250809 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:56:53.254316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:56:53.254316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:56:53.254316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:56:53.263914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:53.264298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:53.264733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:53.265459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:53.265916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:53.266335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:53.285516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Getting quotas for project 4c6e12d2b4fa462eb7cd1275d14faee0. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:56:53.290432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Getting quotas for user b838210ed8ba4cac973eca59c1746c7b and project 4c6e12d2b4fa462eb7cd1275d14faee0. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:56:53.303649 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:56:53.306178 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:56:53.465652 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9a242fcf-ab71-4285-b875-8db13d77871e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655481 Sep 01 13:56:53.466561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 148/306] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:56:53.481775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9e3e0f33-61ff-43bd-a01b-2fa64c7785bc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:53.482895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9e3e0f33-61ff-43bd-a01b-2fa64c7785bc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:53.618099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e3e0f33-61ff-43bd-a01b-2fa64c7785bc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:53.629262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9e3e0f33-61ff-43bd-a01b-2fa64c7785bc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1219 microversion: 2.1 time: 0.155515 Sep 01 13:56:53.630687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 159/307] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:53 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:54.226324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:54.227065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:54.235732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:54.236405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:54.236989 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:54.237699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:54.238152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:54.238578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:54.312549 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:54.320522 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1742362e-5e65-4448-b3c7-1a6c0011de0e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1297 microversion: 2.1 time: 0.098858 Sep 01 13:56:54.321093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 149/308] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:54 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:54.661582 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-90ea796d-b1bd-483e-b595-9a419467aea8 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:54.662216 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-90ea796d-b1bd-483e-b595-9a419467aea8 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:54.720308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90ea796d-b1bd-483e-b595-9a419467aea8 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:54.730668 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-90ea796d-b1bd-483e-b595-9a419467aea8 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1219 microversion: 2.1 time: 0.071225 Sep 01 13:56:54.742122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 160/309] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:54 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:54.981023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:54.987261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:54.987791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:54.988231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.056801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Going to try to stop instance {{(pid=127709) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 13:56:55.072254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:55.341596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:55.342401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:55.356601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.357205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.357708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.358481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.359001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.359528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.412393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-123d1669-e766-4b65-835b-a65cf50729f1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action" status: 202 len: 0 microversion: 2.1 time: 0.435723 Sep 01 13:56:55.413775 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 150/310] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:56:54 2022] POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:56:55.422170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:55.422875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:55.447933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.447933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.448135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:55.448245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.448245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.448245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.453238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-78dcb9f0-1872-4550-9c4f-9688fa8e2a3b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1315 microversion: 2.1 time: 0.115706 Sep 01 13:56:55.453454 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.455629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 161/311] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:55 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1315 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:55.619787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:55.628637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e8b37a73-ebdd-4a4d-b3a2-d6eb5a1dca08 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.210840 Sep 01 13:56:55.629265 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 151/312] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:55 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:55.752709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:55.753356 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:55.760105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.760670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.761765 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.761891 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:55.762271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:55.762691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:55.846839 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:55.856737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-bc0e256b-1ff7-486f-8ae8-19a48a6ab297 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1215 microversion: 2.1 time: 0.107893 Sep 01 13:56:55.857445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 162/313] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:55 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:56.481747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:56.482369 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:56.491090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:56.491974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:56.492914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:56.493794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:56.494737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:56.495348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:56.650106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:56.650854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:56.658750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:56.659243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:56.659706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:56.660400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:56.660948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:56.661264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:56.690050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:56.694710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-07ff9600-4017-438b-bb56-303d79de930a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.220780 Sep 01 13:56:56.695216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 152/314] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:56 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:56.821701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:56.833938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e3356b71-6759-47c5-953c-c66b54fd11d0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.187700 Sep 01 13:56:56.834547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 163/315] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:56 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:57.074392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:56:57.074506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:57.074506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:57.074669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.074788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.074882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.074968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.075048 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.075127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.075127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.075127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.075127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.075420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] Creating event network-changed:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 13:56:57.075420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-af1c9e63-1445-470e-9ea9-059e47b075e9 req-cf92e62f-9bbf-442b-8bb0-5f891d5563be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Sep 01 13:56:57.075420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 153/316] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:56:57.075635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:57.075635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5646109e-23ad-4122-8e0b-648873729fa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1271 microversion: 2.1 time: 0.095068 Sep 01 13:56:57.075635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 164/317] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:56 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:57.725284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:57.725284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:57.727487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.728234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.728918 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.730306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.730983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.731624 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.861306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:57.866260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:57.884901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.885816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.886611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:57.887907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:57.888737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:57.889490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:58.029754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:58.046694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f596726d-b3f9-4468-b9ba-889d41d6a84c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.330126 Sep 01 13:56:58.046694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 154/318] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:57 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:58.086653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:58.088184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:58.102227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:58.103472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:58.104731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:58.106309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:58.107377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:58.113789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:58.130513 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:58.141330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b6440f56-e331-44b0-ab74-7c8d6ada6d9c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.288670 Sep 01 13:56:58.145599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 165/319] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:57 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:58.218078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:58.231242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7bb2252b-44cd-4bed-b073-fd35875e2fbd tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1277 microversion: 2.1 time: 0.152433 Sep 01 13:56:58.232409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 155/320] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:58 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:59.066417 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:59.067105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:59.073622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.074130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.074558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.075246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.075718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.076129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.167019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:59.168845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:59.176135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.178112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.178607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.179555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.180167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.181259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.232804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:59.240776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2c1ce0a4-11e4-41d8-a288-4acf4a028db3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.178464 Sep 01 13:56:59.241620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 166/321] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:59 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:56:59.259527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:56:59.265322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:56:59.266085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.266574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.267005 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.268377 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:56:59.268779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:56:59.269365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:56:59.344050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:59.352887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bb3c7cca-50fd-4ef7-9542-fd18de479c71 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.190192 Sep 01 13:56:59.353734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 156/322] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:59 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:56:59.438447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:56:59.452340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-98a56f20-3709-43d5-a044-73644acdd7a7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.196620 Sep 01 13:56:59.453654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 167/323] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:56:59 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:00.262934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:00.263553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:00.270572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.274823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.274823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.274823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.274823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.275567 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.376715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:00.377335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:00.383620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.384732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.384878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.385468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.385920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.386873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.489453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:00.499042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d4bd7edc-6ce3-445e-a032-894149aba456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.240560 Sep 01 13:57:00.499821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 157/324] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:00 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:00.508944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07372293-da36-485f-a051-1abc6e745d07", "tag": "0018b3b9-e3ed-424f-977c-a050f79a090d"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:00.534373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.535881 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.536532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.550633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] Creating event network-changed:0018b3b9-e3ed-424f-977c-a050f79a090d for instance 07372293-da36-485f-a051-1abc6e745d07 on hv-cinder-83976 Sep 01 13:57:00.557391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-f06d5ff3-fc2f-4007-9a24-2e8c76949b34 req-9a210e35-f71b-47aa-ae92-3c7b80c17b98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051556 Sep 01 13:57:00.558769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 158/325] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:00.572235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:00.573278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:00.585774 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.586400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.586923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.587794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:00.588379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:00.588875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:00.673248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:00.684247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dca64404-84f5-42e7-b30f-ca9b5b9252de tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.310657 Sep 01 13:57:00.685586 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 168/326] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:00 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:00.927782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:00.936274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fde05c03-fa80-4a1f-bda1-4457db0c1342 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.375171 Sep 01 13:57:00.940295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 159/327] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:00 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:01.522980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:01.524293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:01.530754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.531208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.531853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.532559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.532998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.533587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.673339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:01.681510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3a5063c4-ed10-48e4-ab2c-612972df1926 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.162354 Sep 01 13:57:01.685402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 169/328] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:01 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:01.706063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:01.706852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:01.713385 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.714218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.714484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.714981 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.715467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.715896 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.864129 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:01.878475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b9963895-1faa-4392-9c56-8596751b674b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.176099 Sep 01 13:57:01.879271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 160/329] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:01 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:01.957371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:01.957989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:01.964672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.972063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.972063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.972063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:01.972063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:01.972637 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:01.988780 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:02.156337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:02.164153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-911f31f6-b8a6-466e-87d1-a180c5617179 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.210905 Sep 01 13:57:02.183263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 170/330] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:01 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:02.703389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:02.704317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:02.711253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:02.711932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:02.712624 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:02.713402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:02.713971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:02.714421 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:02.873424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:02.881941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1452ae6d-7e20-4699-bb54-ca114e91766e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.182964 Sep 01 13:57:02.882457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 161/331] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:02 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:02.901423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:02.902248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:02.909337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:02.909822 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:02.910293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:02.911027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:02.911500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:02.911951 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:03.060904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:03.089856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b0469d79-0999-4a85-94ea-fe0f11975a79 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.175068 Sep 01 13:57:03.089856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 171/332] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:02 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:03.202796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:03.203618 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:03.209828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:03.210319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:03.210755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:03.211483 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:03.211936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:03.212362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:03.275416 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:03.309909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=12 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:03.356554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:03.366709 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b03e1d19-6a83-4b6e-9a5c-970b77cc5c52 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.168329 Sep 01 13:57:03.367282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 162/333] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:03 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:03.904478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:03.905166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:03.911245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:03.911849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:03.912278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:03.913302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:03.913927 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:03.914352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:04.098315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:04.098958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:04.108092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:04.108889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:04.109329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:04.110057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:04.110673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:04.111102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:04.116162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:04.124359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-94ff0bec-9c2b-4b28-8a15-25950f498a71 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.224640 Sep 01 13:57:04.139034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 172/334] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:03 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:04.332381 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:04.342984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f740a316-9928-4fae-b217-6560ad6ef43e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.249235 Sep 01 13:57:04.343614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 163/335] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:04 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:04.388894 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:04.389502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:04.395643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:04.396135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:04.396842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:04.397258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:04.397704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:04.398207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:04.645113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:04.653345 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4326f527-c2f9-4394-a85f-4b5ece12e3c3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.268960 Sep 01 13:57:04.653921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 173/336] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:04 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:05.146359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:05.146939 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:05.149507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:05.154671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.155154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.155791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.156696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.157153 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.157583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.316868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:05.327435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9a32cb2d-e798-4551-a217-fb7f85fd228b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.184931 Sep 01 13:57:05.333740 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 164/337] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:05 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:05.362125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=10 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:05.368016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:05.368862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:05.387886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.388726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.389360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.390279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.390916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.391975 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.547159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:05.556058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d802e9ce-0b0b-4b6b-8ded-c742b9934105 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.194519 Sep 01 13:57:05.558941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 174/338] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:05 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:05.675774 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:05.676415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:05.683567 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.684415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.693230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.693230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:05.693230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:05.693230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:05.954015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:05.962140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-896f89c4-05ee-4bf4-ac3a-06ab49c783e6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.290298 Sep 01 13:57:05.962713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 165/339] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:05 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:06.149725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "name": "network-vif-plugged", "status": "completed", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:06.165076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:06.169383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.169872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.170305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.185924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] Creating event network-vif-plugged:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 13:57:06.190737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-5c6d87f7-8c26-4c89-9a46-d52fe1144371 req-9283f68d-cc75-43d0-a859-7863d30c699b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044980 Sep 01 13:57:06.191385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 175/340] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:06.349911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:06.350518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:06.358076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.358614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.359089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.359824 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.360275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.360992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.537031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:06.553072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ec92ddc6-b6ed-4a54-abff-496146a90fd9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.206862 Sep 01 13:57:06.558003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 166/341] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:06 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:06.579564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:06.580316 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:06.587726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.588465 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.589035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.590393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.590994 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.591646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.727881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:06.738079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0482cff0-4353-4dbc-af76-d94cf1cd32ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.163988 Sep 01 13:57:06.751491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 176/342] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:06 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:06.984077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:06.984703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:06.990753 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.991241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.991710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:06.992437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:06.993000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:06.993310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:07.127113 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:07.130536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:07.135147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-75d7df45-bea3-45a2-9511-23d221d4476c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.156003 Sep 01 13:57:07.135750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 167/343] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:06 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:07.575455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:07.576185 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:07.583612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:07.584177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:07.584884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:07.585873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:07.586555 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:07.587188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:07.740130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:07.750915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1b1404d0-4ea5-4a77-9fc4-ac8c7b1a5134 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1370 microversion: 2.1 time: 0.179938 Sep 01 13:57:07.751523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 177/344] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:07 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:07.758409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:07.768010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:07.768010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:07.768010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:07.768010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:07.768403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:07.768610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:07.769026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:07.918248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:07.938175 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bcc2f56d-1509-45b5-b0b7-42d249c36e87 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.180858 Sep 01 13:57:07.939130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 168/345] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:07 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:07.997118 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1426220614", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "networks": [{"uuid": "15aaab34-86a8-4d4a-8685-16ae8d883cfc"}]}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:08.056799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] validate_networks() for [('15aaab34-86a8-4d4a-8685-16ae8d883cfc', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:57:08.156679 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:08.157631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:08.164333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.164817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.165248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.165947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.166452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.166822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.331393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:08.340050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-569fc3a4-cc08-4c33-8028-a78c9730bfe5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.187436 Sep 01 13:57:08.340641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 169/346] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:08 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:08.682368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:57:08.682833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:57:08.683310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:57:08.683745 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:57:08.684156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:57:08.693305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.693799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.699543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.699543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.699543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.699543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.715254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Getting quotas for project f24cccc59b3d405998fcd1284b5b3ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:57:08.719891 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Getting quotas for user 9dc3eb6357854fc29ffa95e76c2abf96 and project f24cccc59b3d405998fcd1284b5b3ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:57:08.734375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:57:08.737306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:57:08.771590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:08.772953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:08.780677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.781163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.781598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.782360 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.782813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.783389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.927752 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:08.935077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-54ee28e9-4191-4d4b-a410-425c5a1d79b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947778 Sep 01 13:57:08.936170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8cbad125-5ded-43c9-aab6-9a8fd32c6e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1563 microversion: 2.1 time: 0.168406 Sep 01 13:57:08.936398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 178/347] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:57:08.937197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 170/348] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:08 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:08.952420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cce6fbe1-7de5-45c8-81ac-0b0e6b3ee6f7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:08.953517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cce6fbe1-7de5-45c8-81ac-0b0e6b3ee6f7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:08.960833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:08.961342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:08.968016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.968599 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.968995 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:08.969696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:08.970150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:08.970575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:09.020166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cce6fbe1-7de5-45c8-81ac-0b0e6b3ee6f7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:09.039445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cce6fbe1-7de5-45c8-81ac-0b0e6b3ee6f7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1214 microversion: 2.1 time: 0.092913 Sep 01 13:57:09.043738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 179/349] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:08 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:09.057525 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:09.058904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:09.068986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:09.069491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:09.069927 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:09.070634 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:09.071089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:09.071594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:09.090049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bb0da876-7acf-4fad-a386-73a579fe0184 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135470 Sep 01 13:57:09.091046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 171/350] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 13:57:08 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:09.362780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:09.363501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:09.371553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:09.372060 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:09.372499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:09.373207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:09.373665 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:09.374090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:09.404555 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:09.419458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f494f339-9b5c-4327-9797-6921c8fa5745 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.374178 Sep 01 13:57:09.434459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 180/351] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:09 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:09.628569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:09.645268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a2fd801f-c984-4ad6-bbdf-95c69e0f5ae9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.286495 Sep 01 13:57:09.646658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 172/352] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:09 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:10.060521 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-527a86c8-5cd3-4144-aa3d-4b1f99938179 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:10.061208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-527a86c8-5cd3-4144-aa3d-4b1f99938179 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:10.156830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-527a86c8-5cd3-4144-aa3d-4b1f99938179 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:10.167993 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-527a86c8-5cd3-4144-aa3d-4b1f99938179 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1214 microversion: 2.1 time: 0.111151 Sep 01 13:57:10.181806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 181/353] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:10 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:10.263270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07372293-da36-485f-a051-1abc6e745d07", "name": "network-vif-plugged", "status": "completed", "tag": "0018b3b9-e3ed-424f-977c-a050f79a090d"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:10.279287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.280333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.281209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.297201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] Creating event network-vif-plugged:0018b3b9-e3ed-424f-977c-a050f79a090d for instance 07372293-da36-485f-a051-1abc6e745d07 on hv-cinder-83976 Sep 01 13:57:10.302720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-292b957d-0e45-45c1-84f0-4d6a76576db8 req-913e1ff0-bd84-4898-ba03-b9911abdfda5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045652 Sep 01 13:57:10.303813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 173/354] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:10.426554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:10.442405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:10.443912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:10.444518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.445067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.445661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.452388 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.452807 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.453648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.454529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.454979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.455431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.469977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] Creating event network-changed:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 13:57:10.485377 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-3e270a95-957c-4f77-838d-76e557b1184b req-ad0f209d-503f-4508-af5c-963c6e9edfee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061087 Sep 01 13:57:10.492733 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 182/355] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:10.681259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:10.683667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:10.699806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.700749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.701374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.703490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:10.705414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:10.706058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:10.763868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:10.773855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9874d292-5235-427c-b860-d1a6f26cb7b1 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.336140 Sep 01 13:57:10.775106 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 174/356] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:10 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:10.946939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:10.958981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6fb4541b-e4f7-43e8-a2a5-f603b0ccb667 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.281295 Sep 01 13:57:10.958981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 183/357] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:10 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:11.190165 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:11.190780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:11.197258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.197698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.199001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:11.199747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.200369 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.200856 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:11.278241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:11.286578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d250f6e2-f7df-435a-bb27-bada5e05a55a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1210 microversion: 2.1 time: 0.100833 Sep 01 13:57:11.287158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 175/358] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:11 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:11.796043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:11.796677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:11.803625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.804159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.804602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:11.805364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.805813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.806238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:11.957375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:11.967626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-128acf8d-165a-4275-834f-7c581efbf592 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.175617 Sep 01 13:57:11.969065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 184/359] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:11 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:11.983185 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:11.983841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:11.990435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.991057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.992751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:11.993814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:11.994351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:11.994858 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:12.139199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:12.150161 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c9a0c74c-554d-4f0b-9397-28b0b8d1038b tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1319 microversion: 2.1 time: 0.171016 Sep 01 13:57:12.150737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 176/360] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:11 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:12.309970 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:12.310660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:12.317246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:12.317729 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:12.318152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:12.318854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:12.319305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:12.319754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:12.401418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:12.410094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-108a0ed8-12f3-44c9-b2e4-76a46060379c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1266 microversion: 2.1 time: 0.103890 Sep 01 13:57:12.410669 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 185/361] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:12 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:12.991824 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:12.992440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:12.999754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.000236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.000666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.001357 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.001814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.002375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.128110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:13.136326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2472d523-33a6-47d0-ac22-ac68db6b0c1c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.148340 Sep 01 13:57:13.136887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 177/362] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:12 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:13.171776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:13.172380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:13.178249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.178711 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.179131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.179826 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.180266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.180678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.317921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:13.325587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-53f89173-81a4-4815-9fd2-48c38e92b792 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1508 microversion: 2.1 time: 0.158219 Sep 01 13:57:13.326146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 186/363] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:13 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:13.432018 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:13.432698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:13.438882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.439323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.439786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.448501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:13.448501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:13.448501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:13.506386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:13.515181 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-04ff68b3-4290-4fa2-8d24-33025ce623f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1266 microversion: 2.1 time: 0.087277 Sep 01 13:57:13.515786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 178/364] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:13 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:14.157687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:14.158454 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:14.165147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:14.165634 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:14.166065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:14.166761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:14.167207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:14.167658 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:14.319717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:14.329605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8c4f20f2-a375-41d6-929d-6505b67ccb5c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.175932 Sep 01 13:57:14.330200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 187/365] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:14 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:14.535986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:14.536594 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:14.543751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:14.544230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:14.544657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:14.545347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:14.545787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:14.546202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:14.623108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:14.631663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cd02eecc-f13c-40a1-b1f1-a5a2da322915 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1274 microversion: 2.1 time: 0.099285 Sep 01 13:57:14.632540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 179/366] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:14 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:15.351247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:15.352224 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:15.358555 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:15.359008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:15.359591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:15.360252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:15.360660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:15.361038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:15.500255 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:15.509106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-612e829f-e58f-409e-b8c2-fbbe80a582ce tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1724 microversion: 2.1 time: 0.161578 Sep 01 13:57:15.509806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 188/367] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:15 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:15.653472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:15.654233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:15.660871 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:15.661356 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:15.661844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:15.662575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:15.663026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:15.663464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:15.876443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:15.884268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4d0e88ee-7d6a-4dde-8747-4bb780bf396b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.234865 Sep 01 13:57:15.884856 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 180/368] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:15 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:16.373409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76dd538-afdd-45d0-8295-562272e42792", "tag": "09367c6e-923d-45cd-8d87-d764f29a007c"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:16.388404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:16.388997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:16.389493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:16.402209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] Creating event network-changed:09367c6e-923d-45cd-8d87-d764f29a007c for instance f76dd538-afdd-45d0-8295-562272e42792 on hv-cinder-83976 Sep 01 13:57:16.407389 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-f83d9786-1eb4-44ff-beec-98aecf2c0fc2 req-7892d655-ba55-4fca-97ff-3ac47622342a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039947 Sep 01 13:57:16.408079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 189/369] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:16.531535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:16.532190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:16.538235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:16.538719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:16.539151 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:16.540323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:16.540812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:16.541241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:16.906671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:16.907381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:16.913635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:16.914104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:16.914529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:16.915212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:16.915681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:16.916092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:16.983979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:16.992873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4cd8b954-4167-4f60-8ad9-27a087e0bc9f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1701 microversion: 2.1 time: 0.465468 Sep 01 13:57:16.993720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 181/370] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:16 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1701 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:17.014590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:17.021158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:17.021673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:17.022110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:17.047165 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Going to try to start instance {{(pid=127709) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 13:57:17.056484 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:17.065853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8dbeef60-4267-42ce-a040-51f75d21d449 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.163276 Sep 01 13:57:17.066990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 190/371] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:16 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:17.244057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d85b3acd-3951-41aa-be65-9499903ff752 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action" status: 202 len: 0 microversion: 2.1 time: 0.232721 Sep 01 13:57:17.244399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 182/372] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:57:17 2022] POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 13:57:17.254176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:17.254176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:17.258729 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:17.259204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:17.259667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:17.260355 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:17.261040 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:17.261209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:17.400165 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:17.404326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:17.409466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-23a98393-b0f2-498a-b815-f7729a78c0dd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1710 microversion: 2.1 time: 0.161335 Sep 01 13:57:17.410038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 191/373] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:17 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:18.087179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:18.087916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:18.094601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:18.095102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:18.095556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:18.096307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:18.096746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:18.097160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:18.227373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:18.234967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fd658330-76e1-4335-b208-71ee2b45d25a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.152531 Sep 01 13:57:18.235568 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 183/374] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:18 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:18.430373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:18.430973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:18.437480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:18.437949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:18.438372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:18.439054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:18.439531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:18.439947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:18.567718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:18.576538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f84c7c52-c39a-4176-acd9-9186dc43780b tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1710 microversion: 2.1 time: 0.149994 Sep 01 13:57:18.577083 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 192/375] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:18 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:19.255670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:19.256288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:19.262772 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:19.263253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:19.263711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:19.264418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:19.264863 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:19.265281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:19.283595 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:19.411207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:19.419674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5154c456-a43e-49ec-ba08-ae020e3a0f00 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.167224 Sep 01 13:57:19.420236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 184/376] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:19 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:19.596997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:19.597605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:19.599717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:19.604991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:19.605495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:19.605926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:19.607200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:19.607681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:19.608091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:19.745291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:19.753598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d31a3df7-632b-486a-b6cb-000d39113a72 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1714 microversion: 2.1 time: 0.160444 Sep 01 13:57:19.754152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 193/377] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:19 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:20.442538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:20.443213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:20.458095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:20.459422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:20.459422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:20.459962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:20.460419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:20.461235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:20.592776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:20.600407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e50606af-24aa-4970-a9ea-7a11fa85fa1b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.163320 Sep 01 13:57:20.600977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 185/378] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:20 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:21.621938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:21.622544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:21.624431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=10 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:21.629129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:21.629599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:21.630023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:21.630710 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:21.631147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:21.631589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:21.765930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:21.773669 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4b326f6a-2b22-494a-af41-c61095236669 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.155541 Sep 01 13:57:21.774222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 194/379] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:21 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:22.795427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:22.796142 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:22.802700 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:22.803175 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:22.803658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:22.804343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:22.804789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:22.805324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:22.949424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:22.957068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a99dd891-9743-4a71-a31c-690cb344e525 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.166572 Sep 01 13:57:22.957717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 186/380] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:22 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:23.980722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:23.981324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:23.987268 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:23.987768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:23.988190 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:23.988859 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:23.989299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:23.989710 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:24.116665 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:24.125184 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-98059aa1-6c39-4f4e-903b-11bb0c293fca tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.148542 Sep 01 13:57:24.125701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 195/381] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:23 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:25.145851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:25.146487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:25.152959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:25.153431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:25.153853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:25.155191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:25.155662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:25.156075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:25.284962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:25.292854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a4e2072f-3d00-42c2-a6b6-0dd80c238506 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.150825 Sep 01 13:57:25.293418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 187/382] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:25 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:26.312895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:26.313451 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:26.319448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:26.319924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:26.320348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:26.321042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:26.321482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:26.321896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:26.459945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:26.468342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3f8e2c3d-250c-4155-8ec4-f0499ee9e05d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.159463 Sep 01 13:57:26.468894 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 196/383] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:26 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:27.490342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:27.490884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:27.499887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:27.499887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:27.499887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:27.500535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:27.500992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:27.501550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:27.645766 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:27.653681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-851749b4-a2f4-44de-91a5-e6d39f651121 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.167450 Sep 01 13:57:27.654247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 188/384] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:27 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:28.675607 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:28.676342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:28.683141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:28.683777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:28.684245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:28.684974 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:28.685452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:28.686458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:28.819947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:28.827614 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dbe2b8d8-a82d-499e-a262-9be2f44fc3b2 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.155881 Sep 01 13:57:28.828177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 197/385] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:28 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:29.848251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:29.848865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:29.855629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:29.856131 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:29.856531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:29.857212 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:29.857662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:29.858078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:29.989845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:29.997451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9e736a86-e6a3-4c03-9636-fe3c52c992d1 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.153132 Sep 01 13:57:29.998034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 189/386] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:29 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:31.017438 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:31.018171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:31.026154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:31.026154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:31.026154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:31.026579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:31.026756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:31.027178 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:31.180288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:31.190047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-772e3c5d-d258-4df5-9b96-e06e0c002d99 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.176294 Sep 01 13:57:31.190787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 198/387] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:31 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:32.210850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:32.211517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:32.217882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:32.218362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:32.218794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:32.219520 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:32.219968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:32.220388 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:32.348441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:32.356662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8fcb1089-4981-4c89-9117-0906d7f416d8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.149713 Sep 01 13:57:32.357224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 190/388] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:32 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:33.377309 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:33.378591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:33.384885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:33.385368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:33.385796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:33.386606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:33.387058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:33.387505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:33.518745 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:33.526226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-584fd51f-45c0-4777-98e1-dbab0652d23a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.152887 Sep 01 13:57:33.526779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 199/389] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:33 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:34.547753 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:34.548387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:34.554775 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:34.555258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:34.555823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:34.556497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:34.556949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:34.557370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:34.691725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:34.699664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-17cb848f-e0c1-4ba7-adba-4bde379b3eb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.155645 Sep 01 13:57:34.700161 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 191/390] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:34 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:35.721557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:35.722170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:35.729991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:35.730523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:35.731102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:35.731928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:35.732555 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:35.732979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:35.866518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:35.874858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c010d290-7efb-41e3-83b7-a660efdb6bde tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.158337 Sep 01 13:57:35.875558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 200/391] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:35 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:36.896275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:36.901029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:36.901029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=56 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:36.904545 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:36.905035 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:36.905475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:36.906198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:36.906786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:36.907216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:37.037972 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:37.045676 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d80f0f78-061b-49d1-8d7f-4d9c715b7cc7 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.154200 Sep 01 13:57:37.046241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 192/392] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:36 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:38.066003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:38.066606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:38.072553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:38.073026 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:38.073450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:38.074128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:38.074568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:38.074983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:38.202017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:38.209664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cf2f57e4-71cb-4510-8b83-a3f8af721bb8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.147481 Sep 01 13:57:38.210228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 201/393] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:38 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:39.230863 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:39.231492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:39.237903 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:39.238402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:39.238826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:39.239550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:39.239998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:39.240903 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:39.376130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:39.384219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c797f8a7-aa3b-4c80-817f-4e210007b934 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.157384 Sep 01 13:57:39.385256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 193/394] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:39 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:40.405564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:40.406169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:40.408770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:40.413552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:40.414028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:40.414449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:40.415132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:40.415605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:40.416022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:40.553235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:40.560872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dc0c174e-0396-4897-9130-3e4dd9520971 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.159249 Sep 01 13:57:40.561416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 202/395] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:40 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:41.581891 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:41.582497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:41.589410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:41.589878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:41.590301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:41.591008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:41.591582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:41.592005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:41.720904 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:41.728845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-26d15d71-b206-4c6b-8954-cce58903f3c4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.150872 Sep 01 13:57:41.729440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 194/396] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:41 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:42.285491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76dd538-afdd-45d0-8295-562272e42792", "name": "network-vif-plugged", "status": "completed", "tag": "09367c6e-923d-45cd-8d87-d764f29a007c"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:42.295102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:42.303830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:42.303830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:42.308096 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] Creating event network-vif-plugged:09367c6e-923d-45cd-8d87-d764f29a007c for instance f76dd538-afdd-45d0-8295-562272e42792 on hv-cinder-83976 Sep 01 13:57:42.313145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-2c9d6701-c7c1-4d0f-a6a0-33a793596386 req-1279a771-d1b9-4d0b-84a4-ecb6c2da278d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 Sep 01 13:57:42.313715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 203/397] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:42.748841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:42.749447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:42.755843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:42.756314 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:42.756734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:42.757409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:42.757850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:42.758264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:42.887784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:42.895525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a091f13a-ed95-4c2c-816e-d98a02714b4d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.150456 Sep 01 13:57:42.896091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 195/398] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:42 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:43.917419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:43.918142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:43.924360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:43.924832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:43.929145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:43.929145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:43.929145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:43.929145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:44.059010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:44.066691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-aff14b9a-179d-49ca-968e-ed644f4af35d tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1314 microversion: 2.1 time: 0.154388 Sep 01 13:57:44.067246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 204/399] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:43 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:45.085749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:45.086935 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:45.093435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:45.093916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:45.094347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:45.095062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:45.095525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:45.095960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:45.229210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:45.237028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b71162cb-3e89-460c-b1c8-7f397b45ff3f tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1498 microversion: 2.1 time: 0.155048 Sep 01 13:57:45.237594 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 196/400] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:45 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:46.510615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:46.511125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:46.517240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:46.517727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:46.518793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:46.519704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:46.520158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:46.520579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:46.546579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:57:46.858647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-209d75e7-6b2d-4888-9a97-a60bdd76c611 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 204 len: 0 microversion: 2.1 time: 0.351555 Sep 01 13:57:46.859553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 205/401] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:57:46 2022] DELETE /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:57:46.869479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:46.872365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:46.877675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:46.878154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:46.878607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:46.879299 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:46.879770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:46.880187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:47.072700 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:47.077291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9d1d1501-bf43-44a2-ba49-f9f9b41070f9 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1504 microversion: 2.1 time: 0.213253 Sep 01 13:57:47.077850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 197/402] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:46 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:47.936023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaef584b-3f3d-4f9e-b815-114e835ce250", "device": "/dev/sdb"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:47.939095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:47.945922 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:47.946421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:47.947151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:47.947876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:47.948327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:47.948749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:48.100684 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:48.101251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:48.108119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 13:57:48.108378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Thu Sep 1 13:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 (ip 10.222.0.50) !!! Sep 01 13:57:48.110886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:48.111427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:48.111864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:48.112656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:48.113110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:48.113529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:48.253343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:48.261357 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4cb89144-ca44-4654-a01a-718e6d0a9e9a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1504 microversion: 2.1 time: 0.165381 Sep 01 13:57:48.261997 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 198/403] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:48 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:48.881363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:49.282742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:49.283499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:49.294977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:49.295501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:49.296836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:49.296836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:49.297094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:49.297508 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:49.392070 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c8f97114-c2d2-40c4-9c13-652a258c1719 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "POST /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.460358 Sep 01 13:57:49.398307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 206/404] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:57:47 2022] POST /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07/os-volume_attachments => generated 194 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:49.444942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:49.453529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-37eb6c82-c42a-43da-9fc9-213162612583 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1504 microversion: 2.1 time: 0.174544 Sep 01 13:57:49.454165 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 199/405] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:49 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:50.122851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76dd538-afdd-45d0-8295-562272e42792", "name": "network-vif-deleted", "tag": "09367c6e-923d-45cd-8d87-d764f29a007c"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:50.133437 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:50.134502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:50.135533 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:50.152337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] Creating event network-vif-deleted:09367c6e-923d-45cd-8d87-d764f29a007c for instance f76dd538-afdd-45d0-8295-562272e42792 on hv-cinder-83976 Sep 01 13:57:50.157563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-c798ac8b-a397-4d18-8283-0e97ce7d9a1a req-f1ec2074-6fba-4c4a-b688-7a0c7419d6c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039376 Sep 01 13:57:50.158178 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 207/406] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:57:50.476583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:50.477394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:50.486396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:50.486870 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:50.487306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:50.488017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:50.488457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:50.489284 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:50.524626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:50.525304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:50.525737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:50.526171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lazy-loading 'fault' on Instance uuid f76dd538-afdd-45d0-8295-562272e42792 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:57:50.569237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:50.571556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=99 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:50.577899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-eb23b662-aa70-4d56-9ee1-3085ded57dee tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 200 len: 1304 microversion: 2.1 time: 0.105818 Sep 01 13:57:50.578480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 200/407] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:50 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:51.599866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:51.600697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: f76dd538-afdd-45d0-8295-562272e42792] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:51.608335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:51.608848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:51.609174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:51.610092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:51.610819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:51.611459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:51.627695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] HTTP exception thrown: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Request method failure captured: Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 HTTP/1.1 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELoxRlJfon-8U6sE8StJw2yugXx_e8Tzi9EJ4hNdUGCchFv9VjkcGHn1jidKEteuNuWAFonFdLzWAhEwn9-VFVZRrZ6RLvUqtMuyM44samuXt131pFdOBcgmTRSO_jfYDqhw-ePepecE7M13vWXtodBfPt8OOt0G6o5C5IUolstX_kw Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: f24cccc59b3d405998fcd1284b5b3ac2 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesActionsTest-2102778823 Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:57:51.629367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f24cccc59b3d405998fcd1284b5b3ac2"}]}] Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesActionsTest-2102778823 Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: f24cccc59b3d405998fcd1284b5b3ac2 Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesActionsTest-2102778823 Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesActionsTest-2102778823-project Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 9dc3eb6357854fc29ffa95e76c2abf96 Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesActionsTest-2102778823-project Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. Sep 01 13:57:51.630991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'f76dd538-afdd-45d0-8295-562272e42792'} Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:57:51.631936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. Sep 01 13:57:51.633428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:57:51.635630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Returning 404 to user: Instance f76dd538-afdd-45d0-8295-562272e42792 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:57:51.635630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-79383f11-b506-4ddf-9af5-bf6aebbc233a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792" status: 404 len: 111 microversion: 2.1 time: 0.035898 Sep 01 13:57:51.635630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 208/408] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:51 2022] GET /compute/v2.1/servers/f76dd538-afdd-45d0-8295-562272e42792 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:57:51.736058 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1137126570", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "networks": [{"uuid": "15aaab34-86a8-4d4a-8685-16ae8d883cfc"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:51.791934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] validate_networks() for [('15aaab34-86a8-4d4a-8685-16ae8d883cfc', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:57:52.173070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:57:52.173569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:57:52.174072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:57:52.174507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:57:52.174938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:57:52.185107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:52.195637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:52.195637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:52.195637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:52.195637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:52.196065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:52.203813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Getting quotas for project f24cccc59b3d405998fcd1284b5b3ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:57:52.207846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Getting quotas for user 9dc3eb6357854fc29ffa95e76c2abf96 and project f24cccc59b3d405998fcd1284b5b3ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:57:52.220910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:57:52.224059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:57:52.389216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-772fae26-902a-4ffb-a288-c3acdab0a86a tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657346 Sep 01 13:57:52.395911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 201/409] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 13:57:52.403313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5b717814-5588-4a8c-b97a-282c77d4caa3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:52.404117 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5b717814-5588-4a8c-b97a-282c77d4caa3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:52.470819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5b717814-5588-4a8c-b97a-282c77d4caa3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:52.481404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5b717814-5588-4a8c-b97a-282c77d4caa3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1214 microversion: 2.1 time: 0.082687 Sep 01 13:57:52.482439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 209/410] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:52 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:53.502582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:53.503193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:53.509924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:53.510412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:53.510842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:53.511592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:53.512043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:53.512471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:53.573971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:53.581712 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6474b7db-29e7-43bb-b7ff-6b7ec11f55b8 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1218 microversion: 2.1 time: 0.083471 Sep 01 13:57:53.582271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 202/411] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:53 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:54.602140 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:54.602746 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:54.610170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:54.611596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:54.611596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:54.611925 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:54.612376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:54.612795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:54.673684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:54.682066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-467ae640-57cf-4230-88aa-927cd7325030 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1266 microversion: 2.1 time: 0.083823 Sep 01 13:57:54.682615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 210/412] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:54 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:55.702359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:55.703001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:55.709506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:55.709991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:55.711686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:55.711686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:55.711686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:55.712033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:55.775799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:55.784077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3624e343-2f9f-4b93-87d2-94f8a148ff97 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1272 microversion: 2.1 time: 0.085791 Sep 01 13:57:55.784647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 203/413] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:55 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:56.804887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc", "tag": "32572426-0686-4744-8965-d4360b9722a6"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:56.811475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:56.812210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:56.816850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:56.817541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:56.818343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:56.818994 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:56.819530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:56.819969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:56.820835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:56.821440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:56.821863 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:56.830315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] Creating event network-changed:32572426-0686-4744-8965-d4360b9722a6 for instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc on hv-cinder-83976 Sep 01 13:57:56.836296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-1dfd9a7e-e760-4280-9005-f33888ab0a4f req-71f4b9fc-0921-4de4-aced-13f7a3b92b61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036499 Sep 01 13:57:56.836889 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 211/414] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:56.990475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:56.998391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cdad3d15-e891-4cf2-8ffd-150e7d46af68 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.192810 Sep 01 13:57:57.001082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 204/415] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:56 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:58.018762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:58.019775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:58.026776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:58.027350 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:58.027858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:58.028691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:58.029210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:58.031556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:58.169362 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:58.177892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cd26249d-4a7f-484c-b7fa-161490de9058 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.163243 Sep 01 13:57:58.178707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 212/416] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:58 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:58.387669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:58.388343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:58.394514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:58.394998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:58.395457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:58.396153 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:58.396628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:58.397054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:58.420958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3c10a1df-48a5-44f3-af71-587c777525fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/ips" status: 200 len: 151 microversion: 2.20 time: 0.037352 Sep 01 13:57:58.421525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 205/417] 10.222.0.50 () {60 vars in 1289 bytes} [Thu Sep 1 13:57:58 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:57:59.198907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:59.200122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:57:59.206572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:59.207055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:59.207516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:59.208215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:57:59.208665 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:57:59.209089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:57:59.356918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:57:59.364811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4ba7d361-c8df-41a3-b1bf-0a151939fe88 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.169792 Sep 01 13:57:59.365512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 213/418] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:57:59 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:00.385966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:00.386536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:00.393578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:00.394059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:00.394492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:00.395183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:00.395653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:00.396074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:00.523425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:00.531821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f42f9eb9-a578-48f7-8fb0-e93560ef6403 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.149745 Sep 01 13:58:00.532396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 206/419] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:00 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:01.551949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:01.552564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:01.558993 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:01.559760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:01.560193 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:01.560882 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:01.561333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:01.561751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:01.690238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:01.697955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-174a075b-b5bd-4991-9c3e-ccdc243cd266 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.149790 Sep 01 13:58:01.698515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 214/420] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:01 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:02.719557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:02.720163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:02.722055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:02.722698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:02.727597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:02.728073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:02.728805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:02.729612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:02.730063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:02.730479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:02.871384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:02.879177 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1d64714f-f0ed-473a-adcb-cbf303337608 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.163778 Sep 01 13:58:02.879767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 207/421] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:02 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:03.077182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:03.077704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:03.079689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:03.085360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.085832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.086264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:03.086954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.087518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.087928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:03.111838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lazy-loading 'flavor' on Instance uuid b96f4b0f-c912-498b-a106-05ad58398708 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:03.631900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cfbf755a-fab4-4a83-9c1f-a1e813eacfc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/action" status: 202 len: 0 microversion: 2.20 time: 0.558509 Sep 01 13:58:03.632518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 215/422] 10.222.0.50 () {62 vars in 1319 bytes} [Thu Sep 1 13:58:03 2022] POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:58:03.641529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:03.642137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:03.648149 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.648617 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.649040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:03.649723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.650225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.650677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:03.779978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:03.788450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:03.789878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:03.791017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-125e93f9-6cd7-433f-aef4-09a7c8582a51 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.154043 Sep 01 13:58:03.791614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 208/423] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:03 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:03.899730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:03.900430 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:03.906670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.907152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.907613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:03.908301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:03.908751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:03.909174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:04.040981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:04.049056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b889dc1f-b99b-4e7f-b686-19ad7b7132cc tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.153616 Sep 01 13:58:04.049605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 216/424] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:03 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:04.816366 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:04.817479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:04.825497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:04.825983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:04.826422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:04.827120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:04.827605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:04.828036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:04.972053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:04.980632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:04.982596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:04.983792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ff9de0ca-3f78-451f-b4f6-96aa4991ede0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.172818 Sep 01 13:58:04.984364 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 209/425] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:04 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:05.069878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:05.070521 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:05.076877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:05.077338 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:05.077769 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:05.078457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:05.078904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:05.079353 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:05.208688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:05.216758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6b1d3be9-3d03-4223-a73a-23f20e5ec195 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.150685 Sep 01 13:58:05.217316 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 217/426] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:05 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:06.007145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:06.007782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:06.014893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:06.015384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:06.015826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:06.016516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:06.016967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:06.017399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:06.148769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:06.156987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:06.158409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:06.159579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7f0073bd-69cf-4889-980b-3a7f3b5a308a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.156358 Sep 01 13:58:06.160137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 210/427] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:06 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:06.237671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:06.238293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:06.244826 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:06.245307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:06.245736 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:06.246431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:06.247068 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:06.248021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:06.382687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:06.390671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-30c3ed5b-62ed-41f4-b954-98e95a9f4567 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.156732 Sep 01 13:58:06.391240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 218/428] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:06 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:06.451414 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc", "name": "network-vif-plugged", "status": "completed", "tag": "32572426-0686-4744-8965-d4360b9722a6"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:06.460930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:06.461503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:06.461962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:06.473089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] Creating event network-vif-plugged:32572426-0686-4744-8965-d4360b9722a6 for instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc on hv-cinder-83976 Sep 01 13:58:06.478385 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-16a5a1b7-46af-402e-856e-fb3867251d77 req-ee27c6a2-24f2-4dc5-8400-5d537be831ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Sep 01 13:58:06.479487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 211/429] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:07.181989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:07.182595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:07.188698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:07.189176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:07.189608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:07.190291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:07.190738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:07.191162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:07.321989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:07.330698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:07.332158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:07.333332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f5ae7cef-02b5-4b95-a015-67193ee68e37 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.155196 Sep 01 13:58:07.333885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 219/430] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:07 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:07.412014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:07.412762 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:07.415127 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:07.420111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:07.420589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:07.421012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:07.421695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:07.422141 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:07.422559 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:07.557104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:07.565390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6e409a48-4797-488a-8c2c-106b0f2a7026 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.157636 Sep 01 13:58:07.565952 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 212/431] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:07 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:08.356939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:08.357547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:08.364016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:08.364494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:08.364923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:08.365611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:08.366056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:08.366474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:08.496364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:08.504539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:08.505978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:08.507125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7ac12f86-ba41-4d4f-b554-281d316de8fc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.154996 Sep 01 13:58:08.507750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 220/432] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:08 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:08.586707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:08.587308 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:08.594391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:08.594864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:08.595290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:08.595993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:08.596434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:08.596850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:08.729643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:08.737342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6d39da40-ea43-4a38-ba71-96745700b004 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.154846 Sep 01 13:58:08.737975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 213/433] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:08 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:09.530744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:09.531344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:09.537795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:09.538266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:09.538700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:09.539403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:09.539848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:09.540359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:09.666876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:09.675546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:09.677072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:09.678241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-151d7965-b613-47dc-a414-8baa54349214 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.151321 Sep 01 13:58:09.678801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 221/434] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:09 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:09.762011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:09.762557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:09.769037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:09.769511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:09.769938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:09.770616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:09.771061 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:09.771508 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:09.901894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:09.909912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d7fcae35-c0df-4645-8d69-38fe49c2359b tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.151810 Sep 01 13:58:09.910475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 214/435] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:09 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:10.701031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:10.701633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:10.704047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:10.708702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:10.709183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:10.709606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:10.710284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:10.710722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:10.711133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:10.845478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:10.853651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:10.855342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:10.857046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8eb6a12d-3516-4331-a1c5-134cab78de88 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.159419 Sep 01 13:58:10.857599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 222/436] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:10 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:10.930847 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:10.931476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:10.938348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:10.938817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:10.939241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:10.939954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:10.940396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:10.940815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:11.069884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:11.077725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-692e3c88-3e11-4ed5-ab60-c79abc2611f5 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1314 microversion: 2.1 time: 0.150773 Sep 01 13:58:11.087536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 215/437] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:10 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:11.880663 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:11.881210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:11.888371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:11.888873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:11.889279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:11.889961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:11.890407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:11.890827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:11.905464 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:12.019871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:12.027686 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:12.029219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:12.030356 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eca7c7eb-1e90-4eda-95eb-41c41a7084be tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.153742 Sep 01 13:58:12.030911 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 223/438] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:11 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:12.097993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:12.098662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:12.105378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:12.105849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:12.106276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:12.106953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:12.107429 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:12.107840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:12.240728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:12.249233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-597e978c-39ea-46fd-8e6a-4c2d217450fb tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1498 microversion: 2.1 time: 0.155107 Sep 01 13:58:12.252613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 216/439] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:12 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:13.052518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:13.053208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:13.060408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.060892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.061319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.062010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.062458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.062876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.088583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:13.089075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:13.096126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.096609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.097183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.097899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.098354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.098951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.124873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:58:13.199106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:13.207803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:13.209239 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:13.210387 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5691bcf5-72ed-4cbe-82bf-04143ac4a3f5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.161791 Sep 01 13:58:13.210936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 224/440] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:13 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:13.255193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:13.492786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-aee53513-bfbe-4bd6-9187-4b115ba256bd tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 204 len: 0 microversion: 2.1 time: 0.407837 Sep 01 13:58:13.493305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 217/441] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:58:13 2022] DELETE /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:58:13.501786 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:13.502394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:13.508468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.508937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.509364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.510044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:13.510498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:13.510930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:13.640682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:13.648396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-27954bc1-2328-4d22-a708-e23ec1ba2a0c tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1504 microversion: 2.1 time: 0.150440 Sep 01 13:58:13.648951 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 225/442] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:13 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:14.234475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:14.235165 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:14.242057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:14.242543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:14.242970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:14.243692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:14.244140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:14.245324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:14.376373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:14.384770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:14.386209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:14.387391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b7b3e68c-98d9-444d-9802-ddcd9326b9d7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.157142 Sep 01 13:58:14.388449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 218/443] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:14 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:14.669081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:14.669624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:14.675872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:14.676343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:14.676771 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:14.677447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:14.677887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:14.678300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:14.807750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:14.815945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f8192ba5-8775-4a60-8351-20b674fc3a98 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1504 microversion: 2.1 time: 0.150829 Sep 01 13:58:14.816527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 226/444] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:14 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:15.164092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:15.164584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:15.171137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.171637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.172066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.172746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.173187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.173602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.303945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lazy-loading 'services' on Instance uuid 07372293-da36-485f-a051-1abc6e745d07 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:15.410212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:15.412246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:15.417052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.417531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.417963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.418696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.419812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.420235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.555190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1ba67126-ff18-4c59-8582-96555aca27e5 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07/os-volume_attachments/aaef584b-3f3d-4f9e-b815-114e835ce250" status: 202 len: 0 microversion: 2.1 time: 0.391895 Sep 01 13:58:15.555190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 219/445] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 13:58:15 2022] DELETE /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07/os-volume_attachments/aaef584b-3f3d-4f9e-b815-114e835ce250 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:58:15.631006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:15.640298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:15.641896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:15.643303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d5d924e3-f97a-4877-824b-b88ff6f4e58e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.237020 Sep 01 13:58:15.644282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 227/446] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:15 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:15.837929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:15.838909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:15.846723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.847530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.847931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.848832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.849351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.849840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.854517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc", "name": "network-vif-deleted", "tag": "32572426-0686-4744-8965-d4360b9722a6"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:15.864691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:15.867512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:15.867512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:15.877328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] Creating event network-vif-deleted:32572426-0686-4744-8965-d4360b9722a6 for instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc on hv-cinder-83976 Sep 01 13:58:15.882374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-385b562d-0b6f-4cd7-b755-864ae6ba9c1c req-56b2c8c4-63f1-48dc-9e7e-fc27bc60cc80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Sep 01 13:58:15.882972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 228/447] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:15.916630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:15.924354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-25de1b73-6de3-4d34-9921-50751ccb46b3 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1462 microversion: 2.1 time: 0.091008 Sep 01 13:58:15.924921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 220/448] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:15 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:16.667963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:16.669153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:16.675721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:16.676211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:16.676643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:16.677337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:16.677787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:16.678207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:16.817148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:16.825303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:16.826727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:16.827924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fd1d0f44-1ad9-4699-9393-df54e3e67c8b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.164349 Sep 01 13:58:16.828479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 229/449] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:16 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:16.945355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:16.945891 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:16.952407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:16.952894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:16.953325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:16.954013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:16.954462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:16.954878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:16.986349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:16.986819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:16.987250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:16.987723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lazy-loading 'fault' on Instance uuid ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:17.026890 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc3eb6357854fc29ffa95e76c2abf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24cccc59b3d405998fcd1284b5b3ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:17.035112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-056af0e4-f9ee-48e2-bf21-006b85534a22 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 200 len: 1304 microversion: 2.1 time: 0.093774 Sep 01 13:58:17.035712 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 221/450] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:16 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:17.737341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:17.737848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:17.744324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:17.744796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:17.745248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:17.745930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:17.746374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:17.747293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:17.772982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:58:17.850628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:17.854465 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:17.858505 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:17.858989 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:17.859456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:17.860152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:17.860605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:17.861025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:17.998457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:18.006473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:18.007922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:18.015283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-34f60e07-c5fa-4b3f-853c-2122b369f907 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.162338 Sep 01 13:58:18.015283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 222/451] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:17 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:18.056462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:18.057010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] [instance: ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:18.063611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:18.064126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:18.064553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:18.065234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:18.065676 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:18.066096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:18.079983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] HTTP exception thrown: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Request method failure captured: Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc HTTP/1.1 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELoxRlJfon-8U6sE8StJw2yugXx_e8Tzi9EJ4hNdUGCchFv9VjkcGHn1jidKEteuNuWAFonFdLzWAhEwn9-VFVZRrZ6RLvUqtMuyM44samuXt131pFdOBcgmTRSO_jfYDqhw-ePepecE7M13vWXtodBfPt8OOt0G6o5C5IUolstX_kw Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: f24cccc59b3d405998fcd1284b5b3ac2 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-VolumesActionsTest-2102778823 Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:58:18.081642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f24cccc59b3d405998fcd1284b5b3ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f24cccc59b3d405998fcd1284b5b3ac2"}]}] Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-VolumesActionsTest-2102778823 Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: f24cccc59b3d405998fcd1284b5b3ac2 Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-VolumesActionsTest-2102778823 Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-VolumesActionsTest-2102778823-project Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 9dc3eb6357854fc29ffa95e76c2abf96 Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-VolumesActionsTest-2102778823-project Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. Sep 01 13:58:18.083257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc'} Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:18.084115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. Sep 01 13:58:18.085282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:58:18.087030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] Returning 404 to user: Instance ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:18.087030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-02f867cc-a5fa-43fa-9963-df60819255f4 tempest-VolumesActionsTest-2102778823 tempest-VolumesActionsTest-2102778823-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc" status: 404 len: 111 microversion: 2.1 time: 0.030522 Sep 01 13:58:18.087030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 223/452] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:18 2022] GET /compute/v2.1/servers/ddb0d22b-6cfe-4cf2-a30e-d36cbc2f0ddc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 13:58:18.101615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-54362aa8-1f6a-465c-aa49-62bb039339a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 204 len: 0 microversion: 2.1 time: 0.367698 Sep 01 13:58:18.102504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 230/453] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:58:17 2022] DELETE /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:58:18.112677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:18.113323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:18.119286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:18.119800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:18.120235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:18.120950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:18.121383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:18.121838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:18.266943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:18.275580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-afa94b60-e5b4-4874-9f8a-c882a912b385 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1514 microversion: 2.1 time: 0.167681 Sep 01 13:58:18.276453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 224/454] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:18 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:19.033875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:19.034601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:19.041526 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:19.042012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:19.042448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:19.043138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:19.043611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:19.044033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:19.177201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:19.185964 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:19.187419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:19.188730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ecf50571-0e16-40fb-9f25-9299ce044cf7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.159148 Sep 01 13:58:19.189284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 231/455] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:19 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:19.297486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:19.298096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:19.305028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:19.305502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:19.305927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:19.306662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:19.307089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:19.307625 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:19.441291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:19.448970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f38b09ae-212c-4a75-9bfe-f88fb875432e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1514 microversion: 2.1 time: 0.155684 Sep 01 13:58:19.449526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 225/456] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:19 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:20.212229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:20.212746 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:20.219822 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:20.220301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:20.220730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:20.221451 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:20.221920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:20.222342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:20.354929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:20.363060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:20.364569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:20.365738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-531f384c-6c6e-4d96-a11e-62ef088c39f1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.157459 Sep 01 13:58:20.366289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 232/457] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:20 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:20.469750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:20.470314 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:20.476775 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:20.477254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:20.477685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:20.478372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:20.478816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:20.479504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:20.605446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:20.612996 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-de9d9423-9dd5-4f3e-ae33-7fc8f91fcc0e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1514 microversion: 2.1 time: 0.147103 Sep 01 13:58:20.613553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 226/458] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:20 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:21.389132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:21.389730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:21.396183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.396662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.397092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.397812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.398260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.398685 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.526198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:21.534439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:21.535941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:21.537079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3dd1ed15-56b5-49de-bf4d-a8fe17c6aae5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.152400 Sep 01 13:58:21.537628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 233/459] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:21 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:21.634306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:21.634934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:21.644976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.644976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.644976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.644976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.645326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.645326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.665916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb74d05a-4136-44b3-af37-4d33c1ec648b"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:21.668315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:21.675145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.675672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.676114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.676819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:21.677270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:21.677697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:21.781341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:21.788865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-174b016f-060b-4873-9757-f3bb97c6431c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1514 microversion: 2.1 time: 0.158436 Sep 01 13:58:21.789424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 227/460] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:21 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:22.559660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:22.560260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:22.571128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:22.571128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:22.571128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:22.571128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:22.571521 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:22.571521 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:22.704566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:22.713637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:22.715057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:22.716249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1329c698-5b27-4c7a-99b6-bedb5fb7159c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.160738 Sep 01 13:58:22.716806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 228/461] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:22 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:22.810945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:22.811820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:22.818187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:22.822846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:22.822846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:22.822846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:22.822846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:22.823232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.004354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-54528c1d-5eee-4386-9dd5-95fc39cd267b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.342185 Sep 01 13:58:23.011133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 234/462] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:58:21 2022] POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 194 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:58:23.108965 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:23.117374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-20e8d839-68bb-4dde-a73f-d39cd9d51f44 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1514 microversion: 2.1 time: 0.310833 Sep 01 13:58:23.132025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 229/463] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:22 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:23.513778 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07372293-da36-485f-a051-1abc6e745d07", "name": "network-vif-deleted", "tag": "0018b3b9-e3ed-424f-977c-a050f79a090d"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:23.527633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:23.529905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:23.529905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.540089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] Creating event network-vif-deleted:0018b3b9-e3ed-424f-977c-a050f79a090d for instance 07372293-da36-485f-a051-1abc6e745d07 on hv-cinder-83976 Sep 01 13:58:23.545531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-5466e0db-2a4f-4831-8040-7fcdc8bb2e24 req-2b14cf7e-9286-42af-984b-37e805fb6dd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Sep 01 13:58:23.546238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 235/464] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:23.655947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:23.656455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:23.663629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:23.664121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:23.665333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.666431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:23.666909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:23.667327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.741646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:23.742423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:23.750359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:23.751877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:23.752835 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.754431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:23.755385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:23.755960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:23.763909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lazy-loading 'services' on Instance uuid 4925f2c9-4e1b-4fdb-bbc1-bb409727546d {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:23.964307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:23.974243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:23.976495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:23.977676 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-54f6763a-7565-435c-b253-60872a40d6a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.241928 Sep 01 13:58:23.978542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 236/465] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:23 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:24.020998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7569880e-7a66-458a-855d-db444f232095 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments/98fa65d5-587d-4900-9be1-47a00986ab79" status: 202 len: 0 microversion: 2.1 time: 0.369488 Sep 01 13:58:24.021632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 230/466] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 13:58:23 2022] DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments/98fa65d5-587d-4900-9be1-47a00986ab79 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:58:24.150236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:24.150236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:24.150236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:24.150236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:24.151063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:24.151063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:24.151063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:24.151063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:24.184269 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:24.185400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:24.185904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:24.186518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lazy-loading 'fault' on Instance uuid 07372293-da36-485f-a051-1abc6e745d07 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:24.237526 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:24.246895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-324e7bfd-b101-4b09-9edc-dff5c05de553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1309 microversion: 2.1 time: 0.112048 Sep 01 13:58:24.247550 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 237/467] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:24 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:25.006996 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:25.008372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:25.015672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:25.016479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:25.016968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:25.017731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:25.018243 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:25.018753 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:25.179286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:25.209437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:25.212829 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:25.231111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7d87ceab-053a-4cec-9c39-74f79fff63d9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.216900 Sep 01 13:58:25.243092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 231/468] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:25 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:25.268823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:25.269443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:25.279904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:25.283984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:25.284420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:25.285160 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:25.285619 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:25.286045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:25.299012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:25.330875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:25.331511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:25.332135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:25.332737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lazy-loading 'fault' on Instance uuid 07372293-da36-485f-a051-1abc6e745d07 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:25.382969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:25.393619 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-120fc304-ceb8-4b3a-9ebc-5ed071261369 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 200 len: 1309 microversion: 2.1 time: 0.128796 Sep 01 13:58:25.394664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 238/469] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:25 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:26.281997 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:26.283608 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:26.301683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:26.302295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:26.302737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:26.303502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:26.304145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:26.304584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:26.416636 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:26.418692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 07372293-da36-485f-a051-1abc6e745d07] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:26.447918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:26.455639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:26.455639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:26.455639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:26.455639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:26.456063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:26.469368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] HTTP exception thrown: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Request method failure captured: Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 HTTP/1.1 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELoh3-ph-HclA1TyKOXKDll2sYi52_Nxn16LXxtkxBWn8qIGNPByWFX8YqmqzBBH4v1lr2x_30NdBO2m4PFawon1Hv3-7m5QdoKm4W2EkTum-nFkht0O1pOz2v3L6pAh2wLJkCgZoilSdpCUWimvk_G7ZusTDfxVxgxXd2I6mQmCrQc Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 4c6e12d2b4fa462eb7cd1275d14faee0 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 13:58:26.471304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6e12d2b4fa462eb7cd1275d14faee0"}]}] Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 4c6e12d2b4fa462eb7cd1275d14faee0 Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesSnapshotTestJSON-41051286-project Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: b838210ed8ba4cac973eca59c1746c7b Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesSnapshotTestJSON-41051286-project Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. Sep 01 13:58:26.472852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '07372293-da36-485f-a051-1abc6e745d07'} Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:26.473776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. Sep 01 13:58:26.475218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 13:58:26.476682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Returning 404 to user: Instance 07372293-da36-485f-a051-1abc6e745d07 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:26.476682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-136ac293-be6e-4bef-b68d-8045e9c579fb tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07" status: 404 len: 111 microversion: 2.1 time: 0.062978 Sep 01 13:58:26.476682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 239/470] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:26 2022] GET /compute/v2.1/servers/07372293-da36-485f-a051-1abc6e745d07 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:58:26.506598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:26.515095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:26.516746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:26.517922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-662e39bc-1a87-4b1a-9137-796295e86ac1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.240061 Sep 01 13:58:26.518494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 232/471] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:26 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:27.544871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:27.546725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:27.557928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:27.558818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:27.560042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:27.562004 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:27.563201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:27.564561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:27.712905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:27.722985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:27.725086 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:27.726357 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-50570101-c1ae-4a8e-b412-ae81b32072d8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1744 microversion: 2.20 time: 0.188940 Sep 01 13:58:27.727100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 240/472] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:27 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:28.749990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:28.750674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:28.757496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:28.758253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:28.758880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:28.759830 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:28.760368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:28.760852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:28.764028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:28.924457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:28.933203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:28.938913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:28.938913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f05e04c6-f6dc-4dd5-9c7d-0a8d03c9bce1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1744 microversion: 2.20 time: 0.190014 Sep 01 13:58:28.938913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 233/473] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:28 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:29.959428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:29.960153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:29.966099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:29.966587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:29.967036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:29.967808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:29.968260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:29.968681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:30.135916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:30.155861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:30.157298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:30.158470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b9cfb01e-4b7d-475d-a429-f5cc0b27f901 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1744 microversion: 2.20 time: 0.203371 Sep 01 13:58:30.159326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 241/474] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:29 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:31.194019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:31.195288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:31.208513 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:31.209014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:31.209453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:31.210166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:31.210622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:31.211069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:31.425841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:31.438816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:31.442166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:31.444644 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4ecd5e28-12d0-4961-be7d-ea8c44324e0d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1744 microversion: 2.20 time: 0.256202 Sep 01 13:58:31.446498 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 234/475] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:31 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:32.301320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "name": "network-vif-plugged", "status": "completed", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:32.313919 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:32.314715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:32.315145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:32.343410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] Creating event network-vif-plugged:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:58:32.348758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-d5621bba-9df4-4bde-948e-ce7865a969f3 req-63e8dff8-4a6d-4d1b-8c2f-2527907e1127 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053602 Sep 01 13:58:32.349693 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 242/476] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:32.502197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:32.502801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:32.509288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:32.510643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:32.510643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:32.510934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:32.511337 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:32.511788 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:32.758502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:32.767835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:32.769388 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:32.770801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-87686c5d-68cd-413f-9ae8-152a124da7eb tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.272441 Sep 01 13:58:32.790636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 235/477] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:32 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:33.022139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:33.025226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:33.032997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.033475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.033950 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.034588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.035033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.035479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.061543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'flavor' on Instance uuid b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:58:33.522516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-44dbf5f6-1164-4700-ba42-1900ce27b1e3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/action" status: 200 len: 32 microversion: 2.1 time: 0.505316 Sep 01 13:58:33.523122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 243/478] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:58:33 2022] POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 13:58:33.534050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:33.535999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:33.547868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.548706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.550237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.551240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.552987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.553620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.798447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:33.799519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:33.813507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.814282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.814888 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.816391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.817203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.817949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:34.079462 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:34.088984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:34.093915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:34.103311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:34.108995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-51888fbb-8d5c-4223-ba7f-70afcab7dec3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.315526 Sep 01 13:58:34.121137 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 244/479] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:33 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:34.127130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-52b967ab-86f0-43b7-94e7-8b404f23aeb6 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.597696 Sep 01 13:58:34.145767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 236/480] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:33 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:34.150265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:34.167401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:34.170558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:34.170558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:34.340195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Going to try to stop instance {{(pid=127708) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 13:58:34.580960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-450fd44f-8002-4003-b514-32ab068e1068 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action" status: 202 len: 0 microversion: 2.1 time: 0.458094 Sep 01 13:58:34.581626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 245/481] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:58:34 2022] POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:58:34.590550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:34.592887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:34.608907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:34.631815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:34.631815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:34.631815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:34.631815 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:34.632393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:35.038592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:35.048188 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1c0590d6-15e8-45e9-9ee3-7eca794e0b32 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.462317 Sep 01 13:58:35.049141 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 237/482] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:34 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:35.153104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:35.155490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:35.156394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:35.158930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:35.174218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:35.176194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:35.176710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:35.177220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:35.178469 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:35.181792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:35.182379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:35.182710 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:35.182942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:35.183899 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:35.184635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:35.185273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:35.416329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:35.428432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-594eaca7-52cb-47ba-97e6-187b6f934005 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.279210 Sep 01 13:58:35.441399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:35.455390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 238/483] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:35 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:35.458999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:35.462060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:35.463650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e095bda1-69ba-4c69-9835-4c18f57c7e70 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.319985 Sep 01 13:58:35.465106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 246/484] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:35 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:36.089228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:36.100003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:36.115479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.116293 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.116908 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.117797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.118404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.118992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.274234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:36.283147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-88e99a35-e9a2-4624-bcfd-c4da1c2aad45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.216988 Sep 01 13:58:36.298563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 239/485] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:36 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:36.457004 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:36.458517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:36.467602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.471945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.472668 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.473808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.474655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.475258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.489698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:36.490720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:36.503374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.516240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.518986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.521859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:36.523400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:36.527155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:36.734877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:36.745524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a19090f4-0718-45a1-862f-4f68975d7456 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.292388 Sep 01 13:58:36.761183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 247/486] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:36 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:36.792561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:36.802722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:36.804198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:36.805452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d7dd93d8-c69f-47ca-96e1-49dc7bab1ad6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.320724 Sep 01 13:58:36.821511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 240/487] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:36 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:37.304754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:37.305358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:37.312424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.313127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.313725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:37.314592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.315236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.315833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:37.484276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:37.500106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1070f1f1-c67b-4ee8-bb3c-982ae43913ee tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.197786 Sep 01 13:58:37.501340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 248/488] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:37 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:37.769480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:37.770100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:37.785693 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.786196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.786639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:37.787391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.787846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.788276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:37.829319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:37.829914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:37.851854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.852568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.853307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:37.854186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:37.855056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:37.857826 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:38.059276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:38.068564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7e3e640f-bef8-4dd1-b182-b551a5a4f044 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.306142 Sep 01 13:58:38.091590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 241/489] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:37 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:38.100237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:38.105301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:38.107799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:38.108976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ae4750ce-857b-44ba-9e58-cacdfd057d6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.284171 Sep 01 13:58:38.123987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 249/490] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:37 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:38.522230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:38.522767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:38.533004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:38.533503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:38.533934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:38.534650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:38.535101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:38.535558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:38.861043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-644903805", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "networks": [{"uuid": "22bff36b-44e2-4646-bc3f-14a6a3dc66cf"}]}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:38.877065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:38.889386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ad3614e9-d4f3-49f9-8e42-ebe832d0b8b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.371392 Sep 01 13:58:38.891564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 242/491] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:38 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:39.125185 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:39.127833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:39.152612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:39.211799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.211799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.211799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:39.211799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.212220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.212220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:39.575453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:39.575453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-86f2dc59-ac32-4a17-97cf-d2c6576cbfa2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.422998 Sep 01 13:58:39.575453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 243/492] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:39 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:39.575453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:39.577569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:39.577569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.577569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.577569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:39.577972 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.577972 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.577972 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:39.771695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:39.785590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:39.787013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:39.788194 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e76e12c8-931d-4c04-bc31-3f75aee4cbc9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.246288 Sep 01 13:58:39.788893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 244/493] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:39 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:39.921937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:39.923421 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:39.931126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.931750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.932272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:39.933042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:39.933558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:39.934076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:40.139598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:40.156146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-44381fac-244b-44e2-a682-b1fd6c76ffeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.237811 Sep 01 13:58:40.157137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 245/494] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:39 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:40.600910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:40.601526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:40.608852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:40.612201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:40.612658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:40.613529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:40.613990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:40.614415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:40.790321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:40.802326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-540feb23-0a9b-4538-8cba-80ee18e6b6b1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.205619 Sep 01 13:58:40.802831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 246/495] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:40 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:40.827524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:40.828140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:40.847130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:40.847130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:40.847748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:40.848473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:40.848933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:40.849568 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.002207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:41.016254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:41.017716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:41.018920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8009cd68-18a5-415c-8a66-7e49763bf2e6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.202270 Sep 01 13:58:41.019510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 247/496] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:40 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:41.179475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:41.180366 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:41.187100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.187968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.188628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.189563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.190246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.190874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.303573 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] validate_networks() for [('22bff36b-44e2-4646-bc3f-14a6a3dc66cf', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 13:58:41.391437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:41.401080 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-463b0b43-a5fe-417b-a910-5d194784d903 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.225620 Sep 01 13:58:41.402224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 248/497] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:41 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:41.739702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 13:58:41.740127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 13:58:41.740595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 13:58:41.741247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 13:58:41.741892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 13:58:41.744955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:41.755137 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.755895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.756530 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.757580 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.758244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.758872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.785076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Getting quotas for project 4c6e12d2b4fa462eb7cd1275d14faee0. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:58:41.789963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Getting quotas for user b838210ed8ba4cac973eca59c1746c7b and project 4c6e12d2b4fa462eb7cd1275d14faee0. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:58:41.802583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 13:58:41.805447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 13:58:41.825523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:41.826641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:41.833439 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.835411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.835411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.835827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:41.836220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:41.836639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:41.945343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-87eaffe6-1a69-483a-ab78-1aa79fb886d9 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.090112 Sep 01 13:58:41.952887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 250/498] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 13:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 13:58:41.959101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1c9f53c6-acc2-41cc-af0f-959a53d7ce35 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:41.960036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1c9f53c6-acc2-41cc-af0f-959a53d7ce35 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:42.038102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1c9f53c6-acc2-41cc-af0f-959a53d7ce35 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.046456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.046975 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1c9f53c6-acc2-41cc-af0f-959a53d7ce35 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1218 microversion: 2.1 time: 0.092319 Sep 01 13:58:42.047458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 251/499] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:41 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:42.053525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:42.056499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4b90d025-f7c1-4caf-adf2-5c60efa1aaa1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.235688 Sep 01 13:58:42.067639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:42.067639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:42.069132 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 249/500] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:41 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:42.077757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:42.078506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:42.079153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:42.080132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:42.080824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:42.081320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:42.256609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.275558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.277568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.279021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fd95eda7-3549-4101-b034-f1e92c312249 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.217705 Sep 01 13:58:42.280242 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 252/501] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:42 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:42.425613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:42.426488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:42.436830 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:42.438664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:42.438992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:42.441476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:42.442209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:42.443091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:42.645389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:42.657465 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-29abb5b2-ac85-44b6-9830-29956e330dc5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.236621 Sep 01 13:58:42.658166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 250/502] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:42 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:43.072670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:43.073324 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:43.080962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:43.082371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:43.101279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.101279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.101279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.101279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.101747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.101747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.101892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.101892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.101892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.102539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.103059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.103578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.213551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:43.228772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fb738491-5dc5-40b9-bfe4-d95e1764d2a4 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1222 microversion: 2.1 time: 0.160642 Sep 01 13:58:43.235164 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 253/503] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:43 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:43.288304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:43.298818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-633deb4f-027a-4d75-9fa4-40c803889bdd tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.221423 Sep 01 13:58:43.299419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 251/504] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:43 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:43.302460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:43.303132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:43.310551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.311318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.311886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.312960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.313332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.313766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.331401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:43.466952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:43.475935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:43.477431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:43.478646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eae06cc4-f3dc-446d-beb1-20cbede2f528 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.180442 Sep 01 13:58:43.479232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 254/505] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:43 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:43.680119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:43.680693 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:43.687718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.688197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.688641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:43.689320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:43.689894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:43.690179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.068928 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.077756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d0ab91f4-fe9c-4b53-a4e7-113f476c669d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.401734 Sep 01 13:58:44.078359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 252/506] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:43 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:44.251302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.252947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:44.266518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.266915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.267348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.268102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.270842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.275798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.320964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.321610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:44.328582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.329080 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.329532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.330326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.331202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.332938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.383138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.394054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-73c14f93-bac8-4138-88d9-eef711f077c6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1270 microversion: 2.1 time: 0.147573 Sep 01 13:58:44.395217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 255/507] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:44.505737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.506647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:44.517442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.517949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.518396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.520983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.521615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.522210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.535346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.548412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a07b1bfa-1c10-4b24-a483-8f5e07d0f5cb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.231228 Sep 01 13:58:44.549180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 253/508] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:44.740990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.752888 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.754379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:44.756087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cb33fafe-e22f-47c9-ba42-64b76bac2dc4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.256550 Sep 01 13:58:44.756647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 256/509] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:45.099222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.100186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:45.106230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.106704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.107130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.107853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.108300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.108717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.251064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.260133 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a19909ea-e414-41fe-bf47-65953a66a0e4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.164685 Sep 01 13:58:45.260734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 254/510] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:45.415543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.416265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:45.423738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.424385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.424847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.425627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.426149 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.426770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.496423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.505298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e3207d85-ed84-41a6-8a8e-d565143eaab3 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1278 microversion: 2.1 time: 0.093836 Sep 01 13:58:45.505885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 257/511] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:45.570446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.571079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:45.578499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.579442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.579442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.580202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.580654 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.581071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.779969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.780718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:45.787120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.787742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.788256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.789067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.789611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.790113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.812552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.821584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6432eaff-d221-4b64-bcc6-e8926e9169ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.254894 Sep 01 13:58:45.822259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 255/512] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:45.928407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.937095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.938545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:45.939719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f7b79227-11bb-483d-8c95-dc09e5da585b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1739 microversion: 2.20 time: 0.163892 Sep 01 13:58:45.940280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 258/513] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:46.282596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:46.283204 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:46.289304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.289792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.290225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.290927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.291384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.291818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.498990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:46.507753 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-33c41028-a7c8-41a5-acb7-00b51d24cbeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.229450 Sep 01 13:58:46.508440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 256/514] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:46 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:46.529179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:46.529791 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:46.536670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.537154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.537827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.538740 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.539196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.539653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.801393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:46.809942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a7052fd1-a136-4d4b-b881-f04e0bd7552c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.284444 Sep 01 13:58:46.810536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 259/515] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:46 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:46.842477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:46.843064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:46.850149 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.850668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.851108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.851832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.852281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.853274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.962183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:46.970305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:46.970305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.970305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.970305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:46.970736 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:46.971241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:46.971750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.180601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.190896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.196640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e1fbc098-9462-4c58-90ac-f05b4fb6d34e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.354167 Sep 01 13:58:47.196640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 257/516] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:46 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:47.207394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.209060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.210541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-adbafe50-da80-4bb5-92de-3cd4b208600c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1721 microversion: 2.20 time: 0.252226 Sep 01 13:58:47.211202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 260/517] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:46 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:47.530005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.530613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:47.536939 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:47.537444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:47.537864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.538536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:47.539196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:47.539646 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.575830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b4794a-127e-441a-b576-805a0410eec5", "tag": "71ebcbcb-bba7-4e9a-acf1-965f81733823"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:47.586853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:47.587432 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:47.588108 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.600603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] Creating event network-changed:71ebcbcb-bba7-4e9a-acf1-965f81733823 for instance 24b4794a-127e-441a-b576-805a0410eec5 on hv-cinder-83976 Sep 01 13:58:47.606127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-a6910912-60a9-4842-a132-bc7367526cb4 req-7b4119db-cbcd-49c6-82f2-1219e44d6a7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Sep 01 13:58:47.608100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 261/518] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:47.718333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.726191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8c9bf93a-44dd-4a9e-9305-6a1d948f26ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.200643 Sep 01 13:58:47.726745 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 258/519] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:47.831244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.832002 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:47.838449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:47.839219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:47.839813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.840431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:47.841861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:47.842525 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:47.978679 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:47.987389 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ded4cfd9-bf04-4815-9ef8-2e62a19749a6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.160190 Sep 01 13:58:47.987990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 262/520] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:48.219201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:48.219201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:48.236593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.237351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.237960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.238834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.239523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.240122 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.241474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:48.243054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:48.252907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.253680 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.254817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.255987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.256706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.257762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.409941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:48.419457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b4f163de-d70d-4e50-9227-ca6ddfb3aa0b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.207912 Sep 01 13:58:48.420071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 259/521] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:48 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:48.425183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:48.434985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:48.436285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "name": "network-vif-unplugged", "status": "completed", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:48.436497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:48.437900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f43b2ee7-2f9d-4207-8d7d-b5bbfa66dc86 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1721 microversion: 2.20 time: 0.202759 Sep 01 13:58:48.451399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 263/522] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:48 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:48.451571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.451571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.451571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.459444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] Creating event network-vif-unplugged:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:58:48.464481 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-d7268a0f-8ded-43f4-9db8-bc5aa974411c req-cebbf50f-2f1a-4b28-a298-e33ff58a3bfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039139 Sep 01 13:58:48.465073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 260/523] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:48.748226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:48.748865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:48.755967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.756472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.756935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.757690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:48.758078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:48.758500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:48.903983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:48.912358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c68d0584-c548-4e12-a8c1-9ca1c9d78b25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.168024 Sep 01 13:58:48.923385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 264/524] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:48 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:49.009545 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.010255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:49.017088 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.017970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.018433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.019391 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.019828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.020420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.249288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:49.256619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f03722a7-7d25-4636-ba7e-e6a210364553 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.252064 Sep 01 13:58:49.257340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 261/525] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:49.441698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.442607 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:49.449514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.452649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.452649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.452649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.452649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.453172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.464274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.465173 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:49.473951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.474532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.481310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.481310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.481310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.481310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.635112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:49.644979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1d9a5bc3-861f-42b9-b3f9-06e1c2bb6dd0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.207219 Sep 01 13:58:49.646325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 265/526] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:49.770337 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:49.780630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:49.782710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:49.784179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b7335506-1cc4-49a6-b8b6-90ef8bc43008 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1724 microversion: 2.20 time: 0.325583 Sep 01 13:58:49.785166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 262/527] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:49.806719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "343da168-8585-4ea1-bc0c-29e75b0c6bd2"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:49.809954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:49.816630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.817229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.817546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.818256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.818709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.819130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.934020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.935174 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:49.941271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.941771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.942232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:49.942938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:49.943412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:49.944031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:50.086085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:50.094079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6fe46b6c-8aae-4eac-ab06-3883ba5ecd25 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.163870 Sep 01 13:58:50.094656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 263/528] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:50.277340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:50.278003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:50.285476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:50.285966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:50.286402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:50.287147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:50.287632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:50.288056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:50.425918 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:50.434970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d192796f-cfc3-4ad6-9050-e56067fc7340 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.160807 Sep 01 13:58:50.435626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 264/529] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:50 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:50.669693 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:50.670298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:50.676659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:50.677145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:50.677572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:50.678500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:50.678949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:50.679431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:50.811484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:50.819818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c262e5b2-0ab6-44db-9e7f-fe46b40189d0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.154524 Sep 01 13:58:50.820400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 265/530] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:50 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:50.938597 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d4d7b8fd-dd1f-4170-97fb-dfd330edb7e2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.135733 Sep 01 13:58:50.939743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 266/531] 10.222.0.50 () {62 vars in 1364 bytes} [Thu Sep 1 13:58:49 2022] POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 188 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:58:51.060489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:51.061078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:51.067016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.067540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.067983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.068676 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.069131 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.069561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.114795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127709) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 13:58:51.118968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.118968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:51.123091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.123632 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.124074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.124776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.125260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.125671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.241487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:51.263103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:51.271052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ec578fa4-a30e-4237-a2eb-75b30afcb076 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.158629 Sep 01 13:58:51.271650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 267/532] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:51.456812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.457344 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:51.463781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.463996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.464367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.465059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.465563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.465959 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.555053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e8fa2323-0080-493d-97e3-ee6bc45acb4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/action" status: 202 len: 0 microversion: 2.20 time: 0.498387 Sep 01 13:58:51.556248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 266/533] 10.222.0.50 () {62 vars in 1319 bytes} [Thu Sep 1 13:58:51 2022] POST /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:58:51.564948 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.565636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:51.572116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.572601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.573246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.574160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.575572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.575888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.605564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:51.614007 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-58e51b25-a911-43f5-a798-bf22cdda58df tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.161120 Sep 01 13:58:51.614576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 268/534] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:51.717512 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:51.726803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:51.728274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:51.729432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f1d6ec1a-4ea3-4eb0-8328-b45bf7832ce0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1750 microversion: 2.20 time: 0.168445 Sep 01 13:58:51.729985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 267/535] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:51.845302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.845975 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:51.848012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:51.853911 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.854405 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.854846 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.855834 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:51.856774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:51.857561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:51.863328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:52.014629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.023161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5f53246d-0765-4849-bbe9-7caf34641179 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.182052 Sep 01 13:58:52.023763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 269/536] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:52.292582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:52.294928 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:52.301609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.302417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.302864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.303606 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.304066 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.304496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.498725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.506958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-34b2165b-1596-41fd-8368-db14c24a64ad tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.218616 Sep 01 13:58:52.511424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 268/537] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:52 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:52.636149 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:52.636626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:52.639304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=8 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:52.647566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.647566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.647566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.647566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.648137 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.648137 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.757260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:52.762034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:52.765790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.766572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.766932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.767752 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:52.768212 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:52.768816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:52.814395 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.822824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f792bbad-db01-4edb-8f32-0e6d1b8ce8f1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.190776 Sep 01 13:58:52.823440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 270/538] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:52 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:52.921557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.930383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.931842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:52.933000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a1132744-8340-49e4-a6ef-56275ca9a495 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1750 microversion: 2.20 time: 0.180242 Sep 01 13:58:52.933650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 269/539] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:52 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:53.044992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:53.045603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:53.052639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.053138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.053539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.054272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.054720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.055143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.193579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:53.201849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-361c0e06-e95c-4412-afa4-ac4969ca8178 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.160794 Sep 01 13:58:53.202412 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 271/540] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:53 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:53.530104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:53.530723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:53.537288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.537768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.538200 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.538888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.539335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.539776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.680564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:53.680564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-33347394-2dec-4654-a9c5-96e88820bc83 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.154569 Sep 01 13:58:53.680831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 270/541] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:53 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:53.845566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:53.846180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:53.852349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.852828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.853322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.854266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.854567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.854987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.957200 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:53.957886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:53.964166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.964650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.967119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.967119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:53.967119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:53.967442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:53.988663 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:53.996351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1d304bb0-1a42-433f-9134-4a6a644f7623 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.155265 Sep 01 13:58:53.996925 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 272/542] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:53 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:54.094256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:54.102806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:54.104263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:54.105657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3d3b1dde-4edd-4ca3-b0a6-95b7189124af tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1750 microversion: 2.20 time: 0.152421 Sep 01 13:58:54.106217 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 271/543] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:53 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:54.223243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:54.223804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:54.230241 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:54.230966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:54.231419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:54.232103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:54.232557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:54.232976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:54.382548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:54.391749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-856865f9-a092-49d1-9082-21f838c2d523 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.172415 Sep 01 13:58:54.392319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 273/544] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:54 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:54.701791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:54.702394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:54.709333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:54.709818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:54.710248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:54.710937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:54.711418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:54.711895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:54.845079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:54.853126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dac1a16c-b83b-4700-80ef-d6ae1ad91461 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1678 microversion: 2.1 time: 0.155239 Sep 01 13:58:54.853697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 272/545] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:54 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:55.017095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:55.017606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:55.023812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.024293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.024727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.025424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.025874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.026294 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.128178 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:55.128884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:55.135639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.136119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.136557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.137249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.137703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.138118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.162215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:55.170489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f335c264-4cba-4afb-9fab-08d8e872afb6 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.157251 Sep 01 13:58:55.171055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 274/546] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:55 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:55.266705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:55.275329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:55.276708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:55.278407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-99cba1fc-d3a3-416d-8f3e-cc553feec4a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1750 microversion: 2.20 time: 0.153643 Sep 01 13:58:55.278913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 273/547] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:55 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:55.412961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:55.413592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:55.420163 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.420594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.421020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.421701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.422145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.422557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.555956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:55.564772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1ff27077-4a4e-46df-aa36-035b508ef682 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.155620 Sep 01 13:58:55.565349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 275/548] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:55 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:55.875120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:55.875747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:55.882403 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.882887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.883315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:55.884037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:55.884488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:55.885092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.027613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.035864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-831b8a22-a807-40f3-8d2d-f090dd2b4248 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1655 microversion: 2.1 time: 0.165028 Sep 01 13:58:56.036444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 274/549] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:55 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:56.056087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:56.062793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.063274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.063754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.086574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Going to try to start instance {{(pid=127708) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 13:58:56.191138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:56.191697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:56.197610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.198082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.198506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.199184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.199670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.200104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.304995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8c29cf38-f9f4-47ae-860d-0b16e4594fea tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action" status: 202 len: 0 microversion: 2.1 time: 0.252162 Sep 01 13:58:56.305713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 276/550] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:58:56 2022] POST /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:58:56.316034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:56.317265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:56.328167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.328748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.329304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.330284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.330910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.331568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.341036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.348838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-507c71e2-9da4-47bc-8024-b532d68cba95 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.161396 Sep 01 13:58:56.349422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 275/551] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:56 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:56.367505 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:56.368111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:56.374809 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.375345 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.375979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.376676 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.390320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.390320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.500735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.511161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.514674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.514674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2205e9ec-7b9a-46ab-bb29-00ca65c4f8a7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1752 microversion: 2.20 time: 0.206820 Sep 01 13:58:56.516247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 277/552] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:56 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:56.560534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.568517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-04d0a6c4-f17d-4afd-bdf4-b8c5bca82fb7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1664 microversion: 2.1 time: 0.204728 Sep 01 13:58:56.569104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 276/553] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:56 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:56.586396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:56.587011 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:56.593836 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.594328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.594764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.595494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:56.595988 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:56.596394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:56.744039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:56.752909 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6c4fb9b3-a17f-4280-b1fd-3d1cab8534ee tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.170557 Sep 01 13:58:56.753658 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 278/554] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:56 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:57.370630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:57.371276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:57.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.378789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.379225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.379946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.380400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.380819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.515688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.524001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-30cd48d4-6cac-4ba5-9e89-c38bc0c8c03e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.157344 Sep 01 13:58:57.524584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 277/555] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:57 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:57.542067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:57.542749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:57.549361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.549836 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.550260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.550946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.551408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.551825 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.592097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:57.593048 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:57.607133 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.608139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.608806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.609523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.610167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.610783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.797071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.808044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.810688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.812153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8521a01a-1dd0-474e-b764-c123d6eedb46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1752 microversion: 2.20 time: 0.274042 Sep 01 13:58:57.812795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 279/556] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:57 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1752 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:57.817767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:57.819158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:57.827858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.828716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.829215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.829980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.830501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.831009 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.877206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.883050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e7e15303-86c3-4bb0-9206-6ab2c9be53b9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1664 microversion: 2.1 time: 0.295575 Sep 01 13:58:57.883661 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 278/557] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:57 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1664 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:57.891250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b4794a-127e-441a-b576-805a0410eec5", "name": "network-vif-plugged", "status": "completed", "tag": "71ebcbcb-bba7-4e9a-acf1-965f81733823"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:57.902758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:57.905900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:57.905900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:57.916398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] Creating event network-vif-plugged:71ebcbcb-bba7-4e9a-acf1-965f81733823 for instance 24b4794a-127e-441a-b576-805a0410eec5 on hv-cinder-83976 Sep 01 13:58:57.921670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-1b15f0c7-e4d7-4d93-bdef-e346bdaa11ab req-da39ccda-df98-4767-9bfa-499526649774 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Sep 01 13:58:57.922278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 279/558] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:57.987578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:57.997231 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f240a82a-ffa2-484a-9bb6-fd6f81d7a6ca tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.182393 Sep 01 13:58:57.998074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 280/559] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:57 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:58.545795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:58.546482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:58.553454 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:58.553939 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:58.554376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:58.555067 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:58.555551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:58.555968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:58.836373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:58.836987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:58.844581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:58.845390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:58.846013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:58.846724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:58.847171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:58.847617 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:58.984958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:58.992240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:58.994113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:58.995576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:58.996862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0ff006fa-d9bd-40dd-b472-fcb559648ac4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.164528 Sep 01 13:58:58.997419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 281/560] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:58:58 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:59.001602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fe6d04c4-1f16-4846-b7e2-05739ef2fd7e tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.460546 Sep 01 13:58:59.001939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:59.002384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 280/561] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:58 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:59.002603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:59.008823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:59.009311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:59.009757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:59.010472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:59.010927 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:59.011345 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:59.018583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:59.025456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:58:59.025456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:59.025740 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:59.026179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:59.026892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:59.027452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:59.028468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:59.179997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:59.190926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4e391e23-dc6e-4e7c-bd67-7a755d3aa6fa tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1664 microversion: 2.1 time: 0.192455 Sep 01 13:58:59.192055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 282/562] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:58 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1664 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:59.223011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:58:59.232160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-19e6c444-27e2-4f3e-bbba-1c8d01f4146d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1734 microversion: 2.1 time: 0.217444 Sep 01 13:58:59.232731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 281/563] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:58:59 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:00.020662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.021430 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.022316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.023148 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.028272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.028756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.029404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.029943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.030113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.030567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.030685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.031011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.031135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.032008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.032464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.032911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.174670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.183899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-be102036-f13c-4d8a-b604-22eb0dfa9a06 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1318 microversion: 2.1 time: 0.165553 Sep 01 13:59:00.187923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 282/564] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:00 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:00.212635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.213119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.213338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.221176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.221731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.222170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.222884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.224037 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.224206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.224206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.224736 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.226015 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-220a04ba-53cb-4162-8e44-43593b0a7edc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.209535 Sep 01 13:59:00.226460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 283/565] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:00 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:00.242506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:00.254652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.255254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.261509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.261991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.262456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.263144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.263633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.264051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.374301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.382484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c7b64791-030a-44e5-bebb-17480b0eebb4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1664 microversion: 2.1 time: 0.173755 Sep 01 13:59:00.383067 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 283/566] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:00 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:00.404913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:00.407174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:00.429013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-24f0ce57-de00-4d44-8f86-ffa00c837c39 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1714 microversion: 2.1 time: 0.164196 Sep 01 13:59:00.429013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 284/567] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:00 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1714 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:00.536323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.536822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.544157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.544650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.545080 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.546017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.546467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.546886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.639708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] HTTP exception thrown: Cannot 'detach_volume' instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 while it is in vm_state rescued Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Request method failure captured: Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments/eb74d05a-4136-44b3-af37-4d33c1ec648b HTTP/1.1 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmVaIUV1sZ1FUTBVGQBvgfIMlUjZEa76od2HmAagPN_ZBZ670VhWyVv88yinZkiStz7yP6Z18Y1hZy-dSyapRyaBxqR11xXoSzPS94ieRptpOtYTf3argdr5iRfgG8OVsuicFE9P5Ouv-bLFR-86h9X7d6o9zxYetvfbppnxMztsCw Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:59:00.641302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}] Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5a441adf6eee4ba78992aafbbf02f1c8 Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:59:00.642859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Cannot 'detach_volume' instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 while it is in vm_state rescued Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'server_id': 'b6411fa3-6f19-41fe-ae96-e0e4ea622fd3', 'id': 'eb74d05a-4136-44b3-af37-4d33c1ec648b'} Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:59:00.643670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 while it is in vm_state rescued Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 while it is in vm_state rescued Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:00.645287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Returning 409 to user: Cannot 'detach_volume' instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 while it is in vm_state rescued {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:59:00.646649 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-46f5d584-77a8-4324-9ec6-6670d7738b1b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments/eb74d05a-4136-44b3-af37-4d33c1ec648b" status: 409 len: 152 microversion: 2.1 time: 0.110652 Sep 01 13:59:00.646649 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 284/568] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 13:59:00 2022] DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments/eb74d05a-4136-44b3-af37-4d33c1ec648b => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 13:59:00.652379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:00.653518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.660125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.660616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.661058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.661757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.662306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.662817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.910686 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a6a19d80-ee00-4852-9e75-99976820770e tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/action" status: 202 len: 0 microversion: 2.1 time: 0.262612 Sep 01 13:59:00.911424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 285/569] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:59:00 2022] POST /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:59:00.919252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:00.919927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:00.926756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.927232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.927694 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:00.928379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:00.928836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:00.929259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.059801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.068071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fe6d40aa-ac51-4a5e-8459-2bd250487fea tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1722 microversion: 2.1 time: 0.152600 Sep 01 13:59:01.068626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 285/570] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:00 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:01.206974 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:01.207690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:01.214364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.214837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.215262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.215972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.216415 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.216860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.250574 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:01.251183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:01.257724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.259933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.259933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.259933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.259933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.260361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.362529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.370943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b32d5377-8025-4d76-b783-495f137bdfa2 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1507 microversion: 2.1 time: 0.168432 Sep 01 13:59:01.372191 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 286/571] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:01 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:01.404602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:01.405211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:01.408621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.411611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.412106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.412544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.413330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.413773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.414193 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.417941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.419966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.421126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5e551759-7a14-4912-bb40-4a93877fe23a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.175089 Sep 01 13:59:01.421683 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 286/572] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:01 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:01.434940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61535091-fa7b-4d3b-87fe-6e0b60b1961b", "device": "/dev/sdb"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:01.434940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:01.438531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.439011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.439468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.440168 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:01.440619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:01.441041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:01.628223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:01.639196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0c9c0d1d-998f-4e86-9a40-f1075f1c2ec7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1668 microversion: 2.1 time: 0.238509 Sep 01 13:59:01.645760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 287/573] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:01 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:02.089976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:02.091124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:02.097696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:02.098188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:02.098629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:02.099564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:02.099895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:02.100335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:02.249757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:02.258077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-78acd6b1-64b7-4521-8ffd-af026e4056ab tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1722 microversion: 2.1 time: 0.172135 Sep 01 13:59:02.258647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 288/574] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:02 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:02.271162 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-553bc91b-8560-43a6-9f05-c57a9011c4c7 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "POST /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847383 Sep 01 13:59:02.271788 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 287/575] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 13:59:01 2022] POST /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:02.445874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:02.446503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:02.453141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:02.453788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:02.454219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:02.454915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:02.455407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:02.455833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:02.586180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:02.596376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:02.597794 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:02.598942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e2341dcf-2644-4d8a-9677-c9210057d3d4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.157131 Sep 01 13:59:02.599524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 289/576] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:02 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:03.281091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:03.281869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:03.288361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:03.288850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:03.289446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:03.289980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:03.290434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:03.290858 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:03.440392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:03.458451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ad2cf60c-c11f-47da-bb68-0aa678130e48 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1722 microversion: 2.1 time: 0.173310 Sep 01 13:59:03.458451 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 288/577] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:03 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:03.622931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:03.623739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:03.630753 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:03.631253 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:03.631767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:03.632482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:03.632964 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:03.633389 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:03.767735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:03.776568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:03.778078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:03.779228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f00bba48-62a4-4b6e-944e-793cd8fd5da7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.161005 Sep 01 13:59:03.779812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 290/578] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:03 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:04.472491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:04.474281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:04.483479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.484447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.485220 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:04.486164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.486833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.487559 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:04.658801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:04.668370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-572ecfb9-34e6-48d7-b878-746e89af2df0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1728 microversion: 2.1 time: 0.200595 Sep 01 13:59:04.684014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 289/579] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:04 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:04.696735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:04.697373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:04.705021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.705783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.706315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:04.707237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.708037 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.716956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:04.802133 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:04.803039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:04.806607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:04.815230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.815981 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.816612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:04.816746 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-56c4c28c-dcad-4c10-b26b-f3259ef92a59 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124042 Sep 01 13:59:04.817316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:04.824413 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 291/580] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 13:59:04 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:04.824622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:04.828090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:05.065732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:05.075374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:05.077044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:05.078371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-15ecb156-dc0a-4166-a54a-5ad4014fd5c3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.279989 Sep 01 13:59:05.079154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 290/581] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:04 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:05.947334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:05.971064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:05.971544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:05.971980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:05.986175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] Creating event network-changed:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 13:59:05.992954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-94efbe4d-06e7-4519-8ed3-6107bc686726 req-e56648d8-244e-4416-8678-788beacddae5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049815 Sep 01 13:59:05.994186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 292/582] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:06.104829 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:06.106349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:06.113076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:06.113799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:06.114231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:06.115038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:06.115408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:06.115834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:06.284113 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:06.294190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:06.295952 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:06.297260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c1cdd050-c247-4e46-ae15-df2b3f57fe3b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.196699 Sep 01 13:59:06.297867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 291/583] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:06 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:07.323120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:07.324605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:07.326631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:07.331992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:07.332510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:07.335998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:07.335998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:07.335998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:07.335998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:07.481673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:07.493812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:07.497038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:07.499968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ed1a22a9-0a61-4d91-aa14-bb7884b28a08 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.180579 Sep 01 13:59:07.500796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 293/584] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:07 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:08.010695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:08.022506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:08.023144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:08.023708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:08.039747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] Creating event network-changed:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 13:59:08.044999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-8eead0f1-fd5e-4dac-9126-cbf6d570684a req-c5a50643-beb2-44bc-be2f-19217ead9e3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038689 Sep 01 13:59:08.045680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 292/585] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:08.524227 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:08.525008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:08.532146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:08.532623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:08.533048 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:08.533737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:08.534182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:08.534593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:08.689527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:08.696936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:08.698470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:08.699677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d5554006-00dd-41a5-a206-e1f0193cca2c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.179602 Sep 01 13:59:08.700235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 294/586] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:08 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:09.722889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:09.724307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:09.731630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:09.732428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:09.732635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:09.734119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:09.734725 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:09.735459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:09.916331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:09.928026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:09.929650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:09.931037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-92a6804c-ecc5-4422-8d8b-25b7e8e5c685 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.212621 Sep 01 13:59:09.932034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 293/587] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:09 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:10.954553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:10.955188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:10.961915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:10.962391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:10.962828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:10.963559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:10.964008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:10.964423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:11.108973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:11.118795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:11.120250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:11.121440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f958bd81-d1cd-4358-98ee-241fe07e34fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.171499 Sep 01 13:59:11.122394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 295/588] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:10 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:12.146407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:12.147049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:12.153642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:12.154130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:12.154562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:12.155260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:12.155734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:12.156156 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:12.291051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:12.300095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:12.301532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:12.302906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8e595e13-5397-4ac0-8dbb-4685970faba0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.160231 Sep 01 13:59:12.303547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 294/589] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:12 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:13.326730 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:13.327341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:13.334302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:13.334871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:13.335261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:13.335979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:13.336424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:13.344442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:13.625852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:13.634764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:13.636220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:13.637357 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5a6d04e5-25c9-4a3b-8b97-0785761c64cd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.314581 Sep 01 13:59:13.637916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 296/590] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:13 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:14.660839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:14.661515 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:14.668023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:14.672240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:14.672240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:14.672240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:14.672240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:14.672614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:14.861530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:14.870261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:14.871736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:14.872907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d28bf240-f8e6-4397-abdf-903a07e3f9d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.216081 Sep 01 13:59:14.874118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 295/591] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:14 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:15.903208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:15.903835 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:15.911177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:15.911688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:15.912119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:15.912798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:15.913266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:15.913684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:16.045967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:16.054517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:16.055959 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:16.057107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-528f8770-2af2-4b71-97c6-a9f343cb0ffc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.157771 Sep 01 13:59:16.057656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 297/592] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:15 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:17.080325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:17.080933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:17.087475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:17.087959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:17.088392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:17.089089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:17.089534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:17.089953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:17.218297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:17.227752 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:17.229180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:17.230332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4ac6e375-fedf-45b3-893e-1e51c38740c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.154451 Sep 01 13:59:17.230890 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 296/593] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:17 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:18.227737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:18.228277 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:18.234656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.235161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.235623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.236306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.236750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.237172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.254042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:18.254651 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:18.261342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.261670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lazy-loading 'flavor' on Instance uuid fb5c70b2-5b53-49ff-8dd7-4548972014f7 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:59:18.261836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.262249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.262953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.263416 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.263843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.399285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:18.407954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:18.409394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:18.410544 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-91e3a859-2ec7-4ad1-af29-4ccdeb9f08b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.160929 Sep 01 13:59:18.411109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 297/594] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:18 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:18.568918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-833c42b6-c0db-43b7-a213-9049d9847316 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "POST /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7/action" status: 202 len: 0 microversion: 2.1 time: 0.345207 Sep 01 13:59:18.569508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 298/595] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:59:18 2022] POST /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 13:59:18.577632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:18.579254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:18.584392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.584873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.585305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.585989 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:18.586436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:18.586855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:18.724130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:18.732037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e6290d34-7eb9-4243-9ba7-ea04b0a61f36 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.158201 Sep 01 13:59:18.732602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 298/596] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:18 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:19.434238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:19.434923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:19.441141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:19.441621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:19.442044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:19.442716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:19.443158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:19.443608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:19.459022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:19.574132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:19.583080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:19.584512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:19.585647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1bbecf19-49a1-4d08-aa15-f9ad9b25eea7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.156150 Sep 01 13:59:19.586194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 299/597] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:19 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:19.753511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:19.754033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:19.760484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:19.760966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:19.761399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:19.762083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:19.762536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:19.762957 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:19.778276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:19.895557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:19.903329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fe2ce088-beb4-49f4-83b5-cb33decea987 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.154264 Sep 01 13:59:19.910724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 299/598] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:19 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:20.609568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:20.610308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:20.617321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:20.617968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:20.618409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:20.619317 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:20.625552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:20.625552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:20.850808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:20.860302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:20.861723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:20.862930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6c71ef2b-3533-411e-8f1e-c2d7a00f0cdf tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.257792 Sep 01 13:59:20.863494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 300/599] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:20 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:20.924563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:20.925330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:20.931980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:20.932398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:20.932825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:20.933520 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:20.933961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:20.934379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:21.073610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:21.081650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b7a388b5-9541-49d5-9bc3-d99f01e23947 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.161414 Sep 01 13:59:21.082500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 300/600] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:20 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:21.886318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:21.886913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:21.894162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:21.894644 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:21.895076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:21.895798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:21.896243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:21.896661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:22.036255 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:22.044874 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:22.046299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:22.047485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0ae59232-9eb5-44b5-9cc8-823ab2e20b05 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.165009 Sep 01 13:59:22.048046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 301/601] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:21 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:22.102951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:22.103572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:22.110252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:22.110770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:22.111197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:22.111915 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:22.112355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:22.112768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:22.246536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:22.254960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0c68742c-ce19-412b-9b66-038c924a2e07 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.155875 Sep 01 13:59:22.255561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 301/602] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:22 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:23.070787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:23.071502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:23.078383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:23.078859 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:23.079288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:23.079995 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:23.080444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:23.080863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:23.211515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:23.220601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:23.222022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:23.223179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c86afbb3-f680-4c44-a5f6-ad087e4a90a1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.156340 Sep 01 13:59:23.223754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 302/603] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:23 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:23.275930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:23.276573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:23.283621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:23.284109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:23.284539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:23.285226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:23.285675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:23.286097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:23.422659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:23.430635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-73878617-8ead-453e-b385-24693e2b42ed tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.158529 Sep 01 13:59:23.431208 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 302/604] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:23 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:24.246024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:24.246543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:24.253906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:24.254376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:24.254807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:24.255515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:24.255963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:24.256373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:24.389568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:24.398109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:24.399581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:24.400728 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ace884d3-a0bd-4426-91e7-6a066d0d62b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.158708 Sep 01 13:59:24.401289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 303/605] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:24 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:24.451947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:24.452558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:24.459052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:24.459587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:24.460010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:24.460698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:24.461146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:24.461568 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:24.597098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:24.604696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d9b7d5d0-3321-42fe-b170-8544b95a56c7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.156590 Sep 01 13:59:24.605254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 303/606] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:24 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:25.424760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:25.425513 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:25.432219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:25.432701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:25.433131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:25.433836 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:25.434332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:25.434773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:25.568718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:25.578146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:25.579604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:25.580803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-de3de84b-55e9-429f-9579-cd02d4884ab8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.160345 Sep 01 13:59:25.581508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 304/607] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:25 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:25.625648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:25.626259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:25.632731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:25.633201 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:25.633714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:25.634533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:25.634869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:25.635575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:25.768346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:25.776040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-18cc1827-9a92-40be-9366-3034e0b015c0 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.154468 Sep 01 13:59:25.776592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 304/608] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:25 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:26.183827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "name": "network-vif-plugged", "status": "completed", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:26.193256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:26.193725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:26.194171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:26.205276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] Creating event network-vif-plugged:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 13:59:26.210088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-246ddf8a-81e2-4eae-871e-ee87c79fd233 req-09a62894-a55f-44da-84f7-91af4888c889 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029864 Sep 01 13:59:26.211515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 305/609] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:26.603944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:26.604561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:26.610911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:26.611438 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:26.611922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:26.612576 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:26.613023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:26.613492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:26.748377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:26.757837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:26.759272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:26.760822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2b7d5d77-7bb6-4d9e-b74e-0654ed8f4ff5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.160781 Sep 01 13:59:26.761386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 305/610] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:26 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:26.799478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:26.800166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:26.806499 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:26.806920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:26.808955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:26.808955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:26.808955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:26.808955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:26.941864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:26.949803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9cf37197-2e31-4e54-bfe8-539af704a7a8 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.155595 Sep 01 13:59:26.950305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 306/611] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:26 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:27.783714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:27.784322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:27.790714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:27.791191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:27.791662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:27.792352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:27.792800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:27.793222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:27.921249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:27.929968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:27.931518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:27.932706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-063f1cb8-15ad-442a-8144-feacd0aa2262 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.153570 Sep 01 13:59:27.933272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 306/612] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:27 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:27.970369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:27.970967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:27.977512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:27.977991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:27.978417 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:27.979098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:27.979656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:27.980077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:28.116599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:28.124392 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-26e208e1-dd33-47f7-a0ad-815499a76699 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.157847 Sep 01 13:59:28.125449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 307/613] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:27 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:28.956399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:28.957012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:28.964118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:28.964600 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:28.965731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:28.965878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:28.966216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:28.967266 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:29.102879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:29.112146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:29.113640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:29.114823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-85f07fbc-2a4f-4086-a66a-5cf16e05a8b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.162446 Sep 01 13:59:29.115400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 307/614] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:28 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:29.146511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:29.147116 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:29.153485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:29.153956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:29.154379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:29.155054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:29.155541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:29.156583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:29.286391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:29.294209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7b59a871-5b47-436b-be5f-ed375d68c072 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.151534 Sep 01 13:59:29.294784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 308/615] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:29 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:30.137718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:30.138279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:30.145331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:30.145813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:30.146245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:30.146964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:30.147435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:30.147859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:30.277979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:30.286738 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:30.288205 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:30.289352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-07529245-a644-464b-882d-b3d64aade6c7 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.155596 Sep 01 13:59:30.289910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 308/616] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:30 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:30.314360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:30.314991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:30.321479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:30.321955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:30.322383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:30.323067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:30.323563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:30.323990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:30.457212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:30.464976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-791bbb9d-69e9-41a1-b0e4-12553aa8c535 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.154891 Sep 01 13:59:30.465537 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 309/617] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:30 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:31.312375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:31.312983 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:31.319516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:31.320003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:31.320463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:31.321157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:31.321607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:31.322044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:31.450738 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:31.459917 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:31.461344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:31.462493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3fdb2e81-ad0c-4142-a73f-1428d9473c6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.154015 Sep 01 13:59:31.463052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 309/618] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:31 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:59:31.485718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:31.486327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:31.492743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:31.493206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:31.493631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:31.494302 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:31.494745 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:31.495157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:31.624981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:31.632593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b7f25415-114c-49b8-a794-7302dfc1d1f7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.151049 Sep 01 13:59:31.633154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 310/619] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:31 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:32.486837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:32.487573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:32.494295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:32.494806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:32.495236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:32.495974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:32.496490 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:32.496913 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:32.633819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:32.642772 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:32.644216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:32.645583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-31d27e13-e3e3-4f1b-a5b4-de00387dcf6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1808 microversion: 2.20 time: 0.163209 Sep 01 13:59:32.646146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 310/620] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:32 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:32.656767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:32.657398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:32.663756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:32.664242 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:32.664690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:32.665491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:32.665943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:32.666511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:32.821326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:32.829923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-516c10a4-7d7a-4a8a-a13b-58ce42774d7e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.179795 Sep 01 13:59:32.830498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 311/621] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:32 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:33.669234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:33.669879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:33.676583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:33.677017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:33.677457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:33.678427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:33.678616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:33.679040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:33.813951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:33.822610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:33.824078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:33.825226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b1d59867-f372-4d19-abf7-ade75e76e852 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1795 microversion: 2.20 time: 0.159905 Sep 01 13:59:33.825773 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 311/622] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 13:59:33 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:33.851966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:33.852578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:33.859795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:33.860272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:33.860706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:33.861394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:33.861850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:33.862268 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:33.992135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:34.000290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-996fd8ed-356c-40b4-86d6-1a3b64a484bd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.151838 Sep 01 13:59:34.000848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 312/623] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:33 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:34.147190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:34.147732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:34.153672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:34.154154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:34.154587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:34.155278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:34.155759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:34.156185 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:34.235554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lazy-loading 'services' on Instance uuid 24b4794a-127e-441a-b576-805a0410eec5 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:59:34.427646 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-572335e8-1760-4b7b-8b90-e750365423c1 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5/os-volume_attachments/61535091-fa7b-4d3b-87fe-6e0b60b1961b" status: 202 len: 0 microversion: 2.1 time: 0.284050 Sep 01 13:59:34.428378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 312/624] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 13:59:34 2022] DELETE /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5/os-volume_attachments/61535091-fa7b-4d3b-87fe-6e0b60b1961b => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:59:35.021810 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:35.022398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:35.029179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:35.029664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:35.030091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:35.031527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:35.031985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:35.032405 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:35.203347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:35.211134 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-79d1f3eb-be56-4705-8b45-9c9498dee097 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.193212 Sep 01 13:59:35.211726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 313/625] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:35 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:36.234796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:36.235625 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:36.237559 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=45 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:36.242404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.242882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.243307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:36.244014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.244456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.244868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:36.379819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:36.387612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8a43bf82-8cbc-47c6-95f8-60ff064595b3 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.158330 Sep 01 13:59:36.388183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 313/626] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:36 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:36.603097 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:36.603649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:36.610767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.611240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.611704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:36.612420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.612825 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.613237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:36.637688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:59:36.968604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-acb64642-4ab2-48ef-bf01-10791ee0f0ae tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 204 len: 0 microversion: 2.1 time: 0.368417 Sep 01 13:59:36.969188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 314/627] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:59:36 2022] DELETE /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:59:36.977575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:36.980301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:36.985973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.986448 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.986880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:36.987603 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:36.988053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:36.988464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:37.121283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:37.129210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9e0815ce-54e3-41ac-bd2c-1c53e0167901 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1513 microversion: 2.1 time: 0.155485 Sep 01 13:59:37.129783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 314/628] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:36 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:37.410157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:37.410796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:37.412767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:37.417545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:37.418054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:37.418458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:37.419173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:37.419621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:37.420041 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:37.424129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:37.559441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:37.567453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-bb060ea2-638c-456b-b60f-21fd2d022c0a tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.162324 Sep 01 13:59:37.568015 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 315/629] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:37 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:38.150861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:38.151449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:38.157959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:38.158443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:38.158902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:38.159629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:38.160083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:38.160500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:38.175745 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:38.290086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:38.299068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fe4ab7d7-fc32-41ce-a29e-d2433ae6ee09 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1513 microversion: 2.1 time: 0.152162 Sep 01 13:59:38.299695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 315/630] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:38 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:38.589310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:38.589917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:38.597446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:38.597922 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:38.598352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:38.599037 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:38.599512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:38.599932 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:38.730259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:38.739278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c562c0f2-da76-46f5-8491-f6170e431e54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.153754 Sep 01 13:59:38.739898 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 316/631] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:38 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:39.321318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:39.321926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:39.329064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:39.329546 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:39.329975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:39.330662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:39.331107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:39.331628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:39.471112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:39.479893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-818a59f1-47f0-400e-9661-49725435165c tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1513 microversion: 2.1 time: 0.162257 Sep 01 13:59:39.480499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 316/632] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:39 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:39.763270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:39.765896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:39.770640 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:39.771197 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:39.771714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:39.772407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:39.772852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:39.773313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:39.966596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:39.975144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e89cae18-10b8-4c44-a933-2837931f995f tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.215738 Sep 01 13:59:39.975763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 317/633] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:39 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:40.082749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "name": "network-vif-unplugged", "status": "completed", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:40.093518 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:40.093773 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:40.094150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:40.106608 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] Creating event network-vif-unplugged:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 13:59:40.117532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b4794a-127e-441a-b576-805a0410eec5", "name": "network-vif-deleted", "tag": "71ebcbcb-bba7-4e9a-acf1-965f81733823"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:40.124924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-e8366172-2282-4449-9722-35d68f1ce3f6 req-f6048e11-1953-4c7b-82a9-176fe5e4b689 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032921 Sep 01 13:59:40.125982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 317/634] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:40.135466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:40.135466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:40.135466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:40.146225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] Creating event network-vif-deleted:71ebcbcb-bba7-4e9a-acf1-965f81733823 for instance 24b4794a-127e-441a-b576-805a0410eec5 on hv-cinder-83976 Sep 01 13:59:40.151599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-27867768-9c44-4ed4-a03d-1856850f58ed req-50c75395-c918-41b7-8c8b-dd72d0d40ef0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037813 Sep 01 13:59:40.152444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 318/635] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:40.502675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:40.503396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:40.509897 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:40.510395 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:40.510878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:40.511602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:40.512241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:40.512707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:40.547075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:40.547595 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:40.548136 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:40.548584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lazy-loading 'fault' on Instance uuid 24b4794a-127e-441a-b576-805a0410eec5 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:59:40.591822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b838210ed8ba4cac973eca59c1746c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6e12d2b4fa462eb7cd1275d14faee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:40.600282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1aad92aa-7494-40fb-8084-52b3872b56cc tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 200 len: 1308 microversion: 2.1 time: 0.102981 Sep 01 13:59:40.601025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 318/636] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:40 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:40.997796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:40.998489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:41.005059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.005602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.006033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.006731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.007175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.007620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.158496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:41.166720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-92fe9cd5-1e05-4f54-bf40-1a67b59c67b1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1572 microversion: 2.1 time: 0.173663 Sep 01 13:59:41.167313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 319/637] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:40 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:41.187718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:41.188354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:41.194792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.195400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.195742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.196468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.196900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.197320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.230833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127709) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 13:59:41.481192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8cc7acf1-bd7d-460c-912b-7de371c8e424 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "POST /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7/action" status: 202 len: 0 microversion: 2.1 time: 0.297579 Sep 01 13:59:41.482432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 319/638] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 13:59:41 2022] POST /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:59:41.490384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:41.490990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:41.496934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.497373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.497799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.498585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.499030 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.499960 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.623269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:41.624051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] [instance: 24b4794a-127e-441a-b576-805a0410eec5] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:41.631079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.631940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.632378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.633202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:41.634152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:41.634616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:41.635047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:41.645385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2469afcc-6ec0-4377-ab93-af987ffbd8b7 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1520 microversion: 2.1 time: 0.158779 Sep 01 13:59:41.648237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 320/639] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:41 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:41.652125 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] HTTP exception thrown: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Request method failure captured: Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 HTTP/1.1 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELoh3-ph-HclA1TyKOXKDll2sYi52_Nxn16LXxtkxBWn8qIGNPByWFX8YqmqzBBH4v1lr2x_30NdBO2m4PFawon1Hv3-7m5QdoKm4W2EkTum-nFkht0O1pOz2v3L6pAh2wLJkCgZoilSdpCUWimvk_G7ZusTDfxVxgxXd2I6mQmCrQc Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 4c6e12d2b4fa462eb7cd1275d14faee0 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:59:41.653882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c6e12d2b4fa462eb7cd1275d14faee0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c6e12d2b4fa462eb7cd1275d14faee0"}]}] Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 4c6e12d2b4fa462eb7cd1275d14faee0 Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-41051286 Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-VolumesSnapshotTestJSON-41051286-project Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: b838210ed8ba4cac973eca59c1746c7b Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-VolumesSnapshotTestJSON-41051286-project Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. Sep 01 13:59:41.655502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '24b4794a-127e-441a-b576-805a0410eec5'} Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:59:41.656418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. Sep 01 13:59:41.658038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:41.659577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] Returning 404 to user: Instance 24b4794a-127e-441a-b576-805a0410eec5 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:59:41.659577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-468aad19-0cb9-4eb7-b60a-2c040bcd5fa0 tempest-VolumesSnapshotTestJSON-41051286 tempest-VolumesSnapshotTestJSON-41051286-project] 10.222.0.50 "GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5" status: 404 len: 111 microversion: 2.1 time: 0.039533 Sep 01 13:59:41.659577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 320/640] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:41 2022] GET /compute/v2.1/servers/24b4794a-127e-441a-b576-805a0410eec5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:59:42.666448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:42.667195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:42.674823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:42.675300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:42.676078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:42.676770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:42.677212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:42.677624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:42.825729 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:42.840073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3c039eac-3e8d-4037-9bfe-497a8faa5d2e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1520 microversion: 2.1 time: 0.172095 Sep 01 13:59:42.840073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 321/641] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:42 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:43.856191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:43.856791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:43.864615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:43.865156 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:43.865557 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:43.866248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:43.866785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:43.867233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:44.007601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:44.016254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1bb7c954-aead-4782-828e-aa73b367bd61 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1522 microversion: 2.1 time: 0.163430 Sep 01 13:59:44.016918 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 321/642] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:43 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:45.038765 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:45.039469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:45.046823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:45.047309 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:45.047775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:45.048478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:45.048931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:45.049355 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:45.189918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:45.197738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ced58a76-d357-4d22-a08a-92cdfcae1292 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1522 microversion: 2.1 time: 0.163279 Sep 01 13:59:45.198306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 322/643] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:45 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:46.219937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:46.220497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:46.227061 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:46.227578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:46.228014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:46.228724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:46.229180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:46.229601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:46.367139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:46.375874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-92584135-1cb3-407e-9c57-18286f6aaeef tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1522 microversion: 2.1 time: 0.160427 Sep 01 13:59:46.376456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 322/644] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:46 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:47.399387 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:47.400002 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:47.407087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:47.407524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:47.407951 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:47.408649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:47.409090 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:47.409539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:47.537799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:47.545527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c8227676-ae27-4819-b90a-4c2b257af896 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.149989 Sep 01 13:59:47.547127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 323/645] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:47 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:48.567906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:48.568664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:48.575315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.576962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.576962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.576962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.577399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.577955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.729650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:48.738495 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bdf31d6d-2779-4b2b-abb2-4e0470edeb52 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.174735 Sep 01 13:59:48.741576 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 323/646] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:48 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:49.760862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:49.761496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:49.768480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:49.768964 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:49.769397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:49.770099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:49.770541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:49.770958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:49.918910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:49.929043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d6ea97b2-c2e1-4c28-a249-ab0a6ba94bf5 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.171813 Sep 01 13:59:49.930125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 324/647] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:49 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:50.079248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:50.081376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:50.087744 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.088226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.088680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.089360 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.089806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.090223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.120226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-90101c85-a2ec-46b0-bfa4-3c5d84c764a2 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044750 Sep 01 13:59:50.120705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 324/648] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:50 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 13:59:50.181776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:50.182278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:50.189057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.189544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.189983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.190677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.191132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.191591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.216692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:59:50.507645 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fd29bed8-d70a-4823-ab89-5305fdab7ab0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 204 len: 0 microversion: 2.1 time: 0.329402 Sep 01 13:59:50.508262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 325/649] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:59:50 2022] DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:59:50.516593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:50.517195 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:50.523150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.523657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.524087 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.524776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.525224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.525641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.662105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:50.670010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cd5bdd3f-344c-48b5-80c4-ebcfafb164d4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1674 microversion: 2.1 time: 0.157169 Sep 01 13:59:50.670594 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 325/650] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:50 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:50.950737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:50.951487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:50.958434 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.958912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.959342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:50.960067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:50.960504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:50.960953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:51.105820 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:51.114903 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9dd7f5fe-f25a-4286-ad5f-9958a92c1cdd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.168283 Sep 01 13:59:51.115549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 326/651] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:50 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:51.692696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:51.693420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:51.701476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:51.705514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:51.705514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:51.705514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:51.705514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:51.705850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:51.842050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:51.850262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5f9b3b12-bc4a-4351-b80f-240a2baa6aeb tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1674 microversion: 2.1 time: 0.161616 Sep 01 13:59:51.850865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 326/652] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:51 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:52.137168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:52.137771 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:52.144208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:52.144681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:52.145107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:52.145795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:52.146236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:52.147060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:52.278776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:52.287179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3cd67366-5d26-41d0-9e20-3ae88fa33941 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.153884 Sep 01 13:59:52.287768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 327/653] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:52 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:52.873306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:52.874301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:52.881104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:52.881583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:52.882084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:52.882708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:52.883152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:52.883614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:53.016888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:53.024688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fb423b02-167f-47b1-832f-f9863be16a46 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1674 microversion: 2.1 time: 0.156495 Sep 01 13:59:53.025262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 327/654] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:52 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:53.308409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:53.309099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:53.316298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:53.316885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:53.317415 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:53.318173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:53.318849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:53.319267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:53.604897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:53.613554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b5939652-5330-4e63-b375-df81810420cd tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.309175 Sep 01 13:59:53.614140 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 328/655] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:53 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:54.046319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:54.047041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:54.054077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.054745 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.055092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.055832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.056282 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.056702 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.123185 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:54.132209 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c1c8b916-a062-4038-980d-113fce36c091 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1606 microversion: 2.1 time: 0.089713 Sep 01 13:59:54.132798 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 328/656] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:54 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:54.414277 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4925f2c9-4e1b-4fdb-bbc1-bb409727546d", "name": "network-vif-deleted", "tag": "e211de0e-0032-40b9-9347-9565351509d2"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:54.432157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.432934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.433521 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.446059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] Creating event network-vif-deleted:e211de0e-0032-40b9-9347-9565351509d2 for instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d on hv-cinder-83976 Sep 01 13:59:54.451455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-075702f2-bb96-4159-8ecf-12e07e3c1372 req-7e38ef3c-90a5-44b9-9b79-5f073f2d9667 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042319 Sep 01 13:59:54.453396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 329/657] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 13:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:54.486835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:54.487332 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:54.493635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.494122 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.494563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.495273 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.495757 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.496184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.581374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'services' on Instance uuid b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:59:54.635704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:54.636472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:54.644116 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.645251 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.645910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.646661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.647204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.647798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.790363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:54.798996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a1b011be-f660-4c6e-9c4e-998b98b531e2 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.168298 Sep 01 13:59:54.799607 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 330/658] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:54 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:54.814045 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-27582654-4d51-4e72-b044-45956c5a2cc0 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments/eb74d05a-4136-44b3-af37-4d33c1ec648b" status: 202 len: 0 microversion: 2.1 time: 0.331368 Sep 01 13:59:54.814641 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 329/659] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 13:59:54 2022] DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments/eb74d05a-4136-44b3-af37-4d33c1ec648b => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:59:54.823674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:54.825842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:54.832067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.832792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.843963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.843963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:54.843963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:54.843963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:54.850341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:54.870668 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1010f4bd-7c53-420c-a8a6-d47eec90e221 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051163 Sep 01 13:59:54.871502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 331/660] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:54 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:55.155569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:55.156763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:55.163305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.163829 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.164261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.164956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.165409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.165833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.245234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:55.258099 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-79dc0de7-755f-4e01-82a5-ff53b66dbe43 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1606 microversion: 2.1 time: 0.103605 Sep 01 13:59:55.258099 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 330/661] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:55 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:59:55.821123 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:55.821637 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:55.829772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.830260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.830684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.831412 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.831914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.832330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.884207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:55.886843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:55.893988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.894483 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.894920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.895929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:55.896401 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:55.896832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:55.912855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:55.931731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d1d57a16-86be-429c-9bb9-bc611d7e817b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051433 Sep 01 13:59:55.932321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 331/662] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:55 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:59:55.983394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:55.991585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-53afe2c5-705c-451d-8eeb-fe0a3d64e9a1 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.174372 Sep 01 13:59:55.992188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 332/663] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:55 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:56.275855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:56.276471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:56.283953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:56.284448 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:56.284887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:56.285596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:56.286051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:56.286476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:56.572347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:56.595422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3fa92868-c809-4997-aa24-0f26f1af67c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1606 microversion: 2.1 time: 0.311248 Sep 01 13:59:56.595422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 332/664] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:56 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1606 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:56.944089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:56.946220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:56.953427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:56.953902 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:56.954326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:56.955006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:56.955474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:56.955892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:56.987741 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5f3e5839-e8ac-4626-a3fb-cbb0223b629d tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Sep 01 13:59:56.988332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 333/665] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:56 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:57.013335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:57.013946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:57.020942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:57.021420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:57.021850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:57.022540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:57.022990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:57.023435 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:57.155491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:57.163489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-05719055-c063-4214-bd3b-d35eefed4b54 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.154030 Sep 01 13:59:57.164240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 333/666] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:57 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:57.605107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:57.605904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:57.612742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:57.613282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:57.613709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:57.614387 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:57.614830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:57.615243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:57.647340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:57.647856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:57.648287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:57.648725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lazy-loading 'fault' on Instance uuid 4925f2c9-4e1b-4fdb-bbc1-bb409727546d {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 13:59:57.691303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:57.699868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f9205fb4-79fa-4359-874a-018f8fd690a5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 200 len: 1328 microversion: 2.1 time: 0.099029 Sep 01 13:59:57.700460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 334/667] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:57 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:58.000526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:58.003280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:58.009838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.010322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.010755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.011483 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.011937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.014909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.044443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-afe99153-2001-4e7c-bc47-b54df108136a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048212 Sep 01 13:59:58.045025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 334/668] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:57 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:59:58.186136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:58.186751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:58.193503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.193984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.194418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.195116 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.195596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.196025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.332388 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:58.340565 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1959fbd0-14f9-4505-9e21-de4cd0e38e99 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.158744 Sep 01 13:59:58.341267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 335/669] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:58 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:58.721612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:58.722267 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:58.728442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.728936 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.729376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.730077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:58.730534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:58.730959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:58.745560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d HTTP/1.1 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 13:59:58.747228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 13:59:58.748707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '4925f2c9-4e1b-4fdb-bbc1-bb409727546d'} Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:59:58.750028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 13:59:58.751246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 13:59:58.752374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:59:58.752374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8a63f565-8434-4031-b019-490317c73458 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 404 len: 111 microversion: 2.1 time: 0.031312 Sep 01 13:59:58.752374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 335/670] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:58 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 13:59:58.758334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-97a453e3-43b3-453d-afc0-6c3c6fee204f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '.version_select at 0x7f980ec5e280>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:58.846806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-97a453e3-43b3-453d-afc0-6c3c6fee204f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342911077" status: 202 len: 0 microversion: 2.1 time: 0.092178 Sep 01 13:59:58.847376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 336/671] 10.222.0.50 () {58 vars in 1221 bytes} [Thu Sep 1 13:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342911077 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 13:59:59.056880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:59.059191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:59.066605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.067092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.067757 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.068455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.068995 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.069579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.113041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0cb15fdb-3b7f-4e32-b467-278d55091dfa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060106 Sep 01 13:59:59.114039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 336/672] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 13:59:59 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 13:59:59.195401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:59.196150 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:59.203628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.204379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.204869 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.205584 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.209204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.209204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.242311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 13:59:59.379149 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:59.381912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:59.390054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.390687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.391224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.392072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.392648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.393262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.544378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:59.553325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6e7beb30-b1f0-4a3f-94ab-27c8c40a3840 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.192207 Sep 01 13:59:59.554111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 337/673] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:59 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:59.605141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b742db37-1dfe-40bf-9d55-c7ebe8c4332a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 204 len: 0 microversion: 2.1 time: 0.414029 Sep 01 13:59:59.605735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 337/674] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 13:59:59 2022] DELETE /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 13:59:59.614463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:59.615069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 13:59:59.621487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.621962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.622390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.623080 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:59.623714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:59.624152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:59.705160 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-750cf8a1-6a95-4aa8-b1f1-2fa0a9ad3a3f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: .version_select at 0x7f980ec04940>, body: {"keypair": {"name": "tempest-keypair-1567398978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJjYHMn/ZbmyFPxu0fJbHuhzOK7yck04qaC2tFWQ5jzJKOML4EZoWqFrtN7hUJmfx+gZXb5SeCdt2+BBNLsJZqM48rknKALSzIsDjXzpqB6pb5OSiCSBY8t+Y5XBguBEg=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:59:59.721867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-750cf8a1-6a95-4aa8-b1f1-2fa0a9ad3a3f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for project b0d00b24399a40d2b070bfd90e73f407. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 13:59:59.726128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-750cf8a1-6a95-4aa8-b1f1-2fa0a9ad3a3f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for user e35ebc3dbc1f4f348f97041627fc68b9 and project b0d00b24399a40d2b070bfd90e73f407. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 13:59:59.768020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 13:59:59.776219 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9920edda-6ec7-4b25-86fb-61d87cd8cbdb tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1688 microversion: 2.1 time: 0.165588 Sep 01 13:59:59.776777 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 338/675] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 13:59:59 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:59:59.823017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-750cf8a1-6a95-4aa8-b1f1-2fa0a9ad3a3f tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122381 Sep 01 13:59:59.823657 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 338/676] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 13:59:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:00.574407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:00.575055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:00.581935 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:00.582420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:00.582931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:00.583668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:00.584124 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:00.584750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:00.726000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:00.734472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3e10db0a-8452-453d-a2ee-9dab103f3104 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.163502 Sep 01 14:00:00.735032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 339/677] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:00 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:00.799691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:00.800445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:00.807672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:00.808287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:00.808605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:00.809318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:00.809768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:00.810243 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:00.848464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "name": "network-vif-plugged", "status": "completed", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:00.861151 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:00.861707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:00.862316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:00.875247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] Creating event network-vif-plugged:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 14:00:00.881627 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-ced4e768-0aab-45ff-9cf8-faac9e187f00 req-6b3bdd81-1d81-4045-8dc3-a4907cd96a1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042854 Sep 01 14:00:00.881627 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 340/678] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:00.976153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:00.985228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-003cb8d7-4f8e-4e20-85db-2ebc993a87b2 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1688 microversion: 2.1 time: 0.191378 Sep 01 14:00:00.985812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 339/679] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:00 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:01.757892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:01.758597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:01.765030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:01.766250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:01.766680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:01.767395 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:01.767861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:01.768328 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:01.912993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:01.921453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1baa592c-5ad8-45f7-aa03-53b350cceffa tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.168576 Sep 01 14:00:01.922247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 341/680] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:01 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:02.006588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:02.007126 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:02.013653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.014133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.014571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:02.015896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.016351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.016771 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:02.205633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:02.213900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c56faee7-4d33-42c5-960d-7dd4fa4d7884 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1688 microversion: 2.1 time: 0.211222 Sep 01 14:00:02.214480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 340/681] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:02 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:02.266231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1189527184", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5f5944a-2d48-446c-99f1-160fb52986fb"}], "security_groups": [{"name": "tempest-securitygroup--598435531"}], "key_name": "tempest-keypair-1567398978", "user_data": "}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:02.373346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] validate_networks() for [('e5f5944a-2d48-446c-99f1-160fb52986fb', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:02.821923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:02.822495 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:02.822788 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:02.823186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:02.823614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:02.833414 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.833917 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.834353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:02.835077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.835558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.835980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:02.853717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for project b0d00b24399a40d2b070bfd90e73f407. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:02.858246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Getting quotas for user e35ebc3dbc1f4f348f97041627fc68b9 and project b0d00b24399a40d2b070bfd90e73f407. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:02.870069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:02.872485 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:02.942656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:02.943265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:02.949338 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.949844 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.950276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:02.951059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:02.951422 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:02.951840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:03.018572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5d04946e-1c87-4559-9552-22fa0573ea92 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.757841 Sep 01 14:00:03.020528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 342/682] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:00:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:00:03.030356 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e65ffdc9-c5e9-45ee-b89c-46f5ea3fb843 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:03.031274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e65ffdc9-c5e9-45ee-b89c-46f5ea3fb843 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:03.094628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:03.102137 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-08151280-6df4-49f4-8e41-a2d568f9ce71 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.163281 Sep 01 14:00:03.102721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 341/683] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:02 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:03.102941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e65ffdc9-c5e9-45ee-b89c-46f5ea3fb843 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:03.111821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e65ffdc9-c5e9-45ee-b89c-46f5ea3fb843 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1238 microversion: 2.1 time: 0.085373 Sep 01 14:00:03.112591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 343/684] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:03 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:03.236599 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:03.237211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:03.244003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:03.244492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:03.244929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:03.245635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:03.246085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:03.246511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:03.392770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:03.404945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1e60106b-7c95-4448-baeb-45d8ebb18ba3 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1688 microversion: 2.1 time: 0.172136 Sep 01 14:00:03.404945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 342/685] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:03 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.124149 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.125261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:04.132611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.133203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.133763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.133897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.139629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:04.139736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.139736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.139736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.141803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.142336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.142762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.143477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.143920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.144332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.231737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:04.244865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-45398e4c-5227-4587-a1a1-faea95cb10ae tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1242 microversion: 2.1 time: 0.113847 Sep 01 14:00:04.245783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 343/686] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.294089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:04.302286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6ae3f70e-e47a-4376-9ea7-eeace25d8e75 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1578 microversion: 2.1 time: 0.181961 Sep 01 14:00:04.302875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 344/687] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.425807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.426426 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:04.432404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.432894 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.433365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.434106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.434558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.434982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.529655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:04.549460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0ac367ed-cb17-418c-8549-18af519552fa tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1621 microversion: 2.1 time: 0.127648 Sep 01 14:00:04.563946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 344/688] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1621 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.615920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6411fa3-6f19-41fe-ae96-e0e4ea622fd3", "name": "network-vif-deleted", "tag": "2318c4f1-97f1-4a09-b367-996076fdc8f5"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:04.630320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:04.631001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:04.631616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:04.645322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] Creating event network-vif-deleted:2318c4f1-97f1-4a09-b367-996076fdc8f5 for instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 on hv-cinder-83976 Sep 01 14:00:04.650879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-9a387afb-acce-4e8a-9e83-0337bcf8a006 req-c47bb3b8-5477-452d-97bf-f66cc45afe3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107044 Sep 01 14:00:04.652068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 345/689] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:05.266119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:05.267505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:05.274943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.275590 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.276181 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.276903 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.277455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.277941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.326453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:05.327186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:05.336769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.337261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.337698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.338433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.338884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.339536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.404279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:05.414248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c3007d8a-6a28-414f-9c2c-23c729ea1bd4 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1290 microversion: 2.1 time: 0.152144 Sep 01 14:00:05.415087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 345/690] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:05 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:05.572939 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:05.573773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:05.580214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:05.583103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-07880e16-c4fe-4d2c-a618-ce9e1d569f51 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1565 microversion: 2.1 time: 0.262402 Sep 01 14:00:05.584956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 346/691] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:05 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:05.606703 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.607198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.607912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.611267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.614594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.615215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.654380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:05.654939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:05.655467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:05.655948 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:05.704409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:05.712327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-956707b3-bcc8-499d-984f-5d9d66635359 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 200 len: 1335 microversion: 2.1 time: 0.145265 Sep 01 14:00:05.712910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 346/692] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:05 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:06.447839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:06.448396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:06.450828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:06.455986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:06.456477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:06.456908 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:06.457609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:06.458060 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:06.458478 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:06.528903 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:06.537064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-65ea18f7-e4fd-4a23-bc7e-fe36033ed106 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1308 microversion: 2.1 time: 0.093041 Sep 01 14:00:06.537646 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 347/693] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:06 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:06.732994 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:06.733567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: b6411fa3-6f19-41fe-ae96-e0e4ea622fd3] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:06.740990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:06.741467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:06.741900 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:06.743541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:06.743991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:06.744409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:06.760154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] HTTP exception thrown: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Request method failure captured: Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 HTTP/1.1 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmVaIUV1sZ1FUTBVGQBvgfIMlUjZEa76od2HmAagPN_ZBZ670VhWyVv88yinZkiStz7yP6Z18Y1hZy-dSyapRyaBxqR11xXoSzPS94ieRptpOtYTf3argdr5iRfgG8OVsuicFE9P5Ouv-bLFR-86h9X7d6o9zxYetvfbppnxMztsCw Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:06.761840 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}] Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5a441adf6eee4ba78992aafbbf02f1c8 Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. Sep 01 14:00:06.763884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'b6411fa3-6f19-41fe-ae96-e0e4ea622fd3'} Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:06.766038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. Sep 01 14:00:06.769664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:06.773539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Returning 404 to user: Instance b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:06.773539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-618ce71f-c0e5-4ce9-89ef-b88e09e3ba57 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3" status: 404 len: 111 microversion: 2.1 time: 0.034800 Sep 01 14:00:06.773539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 347/694] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:06 2022] GET /compute/v2.1/servers/b6411fa3-6f19-41fe-ae96-e0e4ea622fd3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:06.776419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bba8a2d9-45a8-47f5-b78a-a562bd4f2075 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '.version_select at 0x7f980eae71f0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:06.943507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bba8a2d9-45a8-47f5-b78a-a562bd4f2075 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803366237" status: 202 len: 0 microversion: 2.1 time: 0.173174 Sep 01 14:00:06.944098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 348/695] 10.222.0.50 () {58 vars in 1218 bytes} [Thu Sep 1 14:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803366237 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:00:07.561497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:07.562445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:07.571385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:07.574055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:07.574842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:07.575554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:07.576998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:07.578283 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:07.579810 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:07.599720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:07.771906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:07.784979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-67128729-8399-4dcc-bb1d-a06c1e619f8c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.230305 Sep 01 14:00:07.799547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 348/696] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:07 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:08.480388 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ce52de-2a26-4f78-8ff8-a8239eaf5939", "tag": "b00b2c4e-5c8d-4210-be06-e5dd71e0a08f"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:08.492449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:08.492930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:08.493365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:08.504482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] Creating event network-changed:b00b2c4e-5c8d-4210-be06-e5dd71e0a08f for instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 on hv-cinder-83976 Sep 01 14:00:08.509879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-920ac96b-3482-49ab-848e-6905d5893dd4 req-5f07a37b-ecf8-468d-9e36-dc9e0f6e0d2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033435 Sep 01 14:00:08.510926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 349/697] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:08.807336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:08.808616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:08.818919 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:08.819748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:08.820358 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:08.821260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:08.821886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:08.822314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:09.073802 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:09.084232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-75710867-c721-4aa6-b27a-c8b24195415c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.280299 Sep 01 14:00:09.088677 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 349/698] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:08 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:10.106929 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:10.107923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:10.117880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.118167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.118678 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.119394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.120792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.120792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.259850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:10.268131 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6cd7b043-bd10-44e3-95f8-fc7b94210798 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.165883 Sep 01 14:00:10.268714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 350/699] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:10 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:10.395203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:10.396028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:10.398024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:10.404229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.404720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.405165 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.406549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.407188 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.407682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.433996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:00:10.804483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-69c28b3b-0d06-41d9-afa2-423bfeafed4c tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 204 len: 0 microversion: 2.1 time: 0.414725 Sep 01 14:00:10.805073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 350/700] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:00:10 2022] DELETE /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:00:10.813861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:10.814527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:10.820502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.820985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.821423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.822144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:10.822596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:10.823147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:10.966031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:10.973961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e2a4d240-626d-4d77-a064-516499c5c7c7 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1507 microversion: 2.1 time: 0.164562 Sep 01 14:00:10.974536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 351/701] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:10 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:11.290394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:11.291119 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:11.297745 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:11.298221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:11.298649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:11.299451 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:11.299799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:11.304761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:11.432884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:11.440649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b368956d-8e12-418e-9e17-846d373042ac tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.154475 Sep 01 14:00:11.443488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 351/702] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:11 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:11.994886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:11.995526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:12.002631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:12.003120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:12.003588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:12.004290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:12.004839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:12.005267 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:12.135767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:12.144029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f26ac89c-c9cb-4796-8ba6-116add1b7709 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1507 microversion: 2.1 time: 0.153277 Sep 01 14:00:12.144917 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 352/703] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:11 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:12.461453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:12.462096 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:12.469158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:12.469638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:12.470071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:12.473074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:12.473074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:12.473074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:12.704534 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:12.714931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-133b8fe8-5f78-4fc0-8ccf-7d53ddb7d2b7 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.257195 Sep 01 14:00:12.728177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 352/704] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:12 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:13.129511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd192f7-8775-4aa6-b31c-55b0d16aa6c7", "name": "network-vif-deleted", "tag": "910a478c-75dd-4598-95e4-2c4cea800092"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:13.135117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:13.136326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=8 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:13.142636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:13.143133 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:13.143591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:13.155079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] Creating event network-vif-deleted:910a478c-75dd-4598-95e4-2c4cea800092 for instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 on hv-cinder-83976 Sep 01 14:00:13.161519 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-2ef7f28b-0a16-4a7a-9c6f-702033522f35 req-5f38a06a-cea7-4aa6-b97e-2b327b0d9345 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037137 Sep 01 14:00:13.162952 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 353/705] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:13.166152 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:13.166740 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:13.173368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:13.174410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:13.177279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:13.177279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:13.177279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:13.177279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:13.290063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:13.290063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b9ccf3af-4ff4-40a0-acc7-1f0a62577245 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1465 microversion: 2.1 time: 0.115630 Sep 01 14:00:13.290063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 353/706] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:13 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1465 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:13.739422 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:13.741698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:13.747921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:13.748412 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:13.748838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:13.749613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:13.752349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:13.752349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:13.754985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=100 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:13.899176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:13.907407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cc787adb-4556-43a4-b4b1-20916087ca30 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.173388 Sep 01 14:00:13.907985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 354/707] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:13 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:14.302424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:14.303035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:14.309561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:14.310046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:14.310481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:14.311181 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:14.311663 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:14.312089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:14.347704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:14.348201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:14.348651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:14.349104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:14.394219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:14.401958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-19e09f51-c600-43e1-a4ee-2d2bffce7707 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1311 microversion: 2.1 time: 0.103416 Sep 01 14:00:14.402528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 354/708] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:14 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:14.928417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:14.928955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:14.935876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:14.938894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:14.938894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:14.938894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:14.938894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:14.939260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:15.072295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:15.080030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fafbc8b4-6514-415d-947c-49a43844ced3 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.155617 Sep 01 14:00:15.082153 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 355/709] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:14 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:15.422882 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:15.423534 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:15.430239 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:15.430720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:15.431155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:15.431885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:15.432331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:15.432750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:15.463224 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:15.463732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:15.464167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:15.464611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:15.506824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:15.514419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5e834483-af2a-42fb-9cd7-1766326e5321 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1311 microversion: 2.1 time: 0.096197 Sep 01 14:00:15.515490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 355/710] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:15 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:16.100600 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:16.101171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:16.108382 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.108830 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.109274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.109973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.110434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.110862 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.243444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:16.251516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b9ae8a66-b081-42e1-abd3-ff60631d2bf8 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.154821 Sep 01 14:00:16.252086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 356/711] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:16 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:16.535067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:16.535720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:16.542384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.542860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.543287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.544012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.544456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.544875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.577125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.577581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.578031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.578436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:16.618763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:16.627266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-54924cfd-c4ab-4d0a-9990-98c963b2ab6a tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 200 len: 1311 microversion: 2.1 time: 0.095901 Sep 01 14:00:16.627829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 356/712] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:16 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:16.702962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:16.703482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:16.709567 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.711036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.711036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.711279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.711711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.712681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.745619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-74b9fc57-28dd-482b-a34f-cea0048a076a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments/343da168-8585-4ea1-bc0c-29e75b0c6bd2" status: 200 len: 194 microversion: 2.20 time: 0.046048 Sep 01 14:00:16.757302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 357/713] 10.222.0.50 () {60 vars in 1454 bytes} [Thu Sep 1 14:00:16 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments/343da168-8585-4ea1-bc0c-29e75b0c6bd2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:00:16.816568 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:16.817075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:16.823040 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.823552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.823979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.824731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:16.825177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:16.825592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:16.964624 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lazy-loading 'services' on Instance uuid b96f4b0f-c912-498b-a106-05ad58398708 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:17.130570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ce52de-2a26-4f78-8ff8-a8239eaf5939", "name": "network-vif-plugged", "status": "completed", "tag": "b00b2c4e-5c8d-4210-be06-e5dd71e0a08f"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:17.140724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.141207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.141636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.156094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] Creating event network-vif-plugged:b00b2c4e-5c8d-4210-be06-e5dd71e0a08f for instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 on hv-cinder-83976 Sep 01 14:00:17.164832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-3f9ebd98-ded6-4796-92ce-cd4d7ae250e5 req-8249c5e9-080b-4770-825e-6192d38045aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170849 Sep 01 14:00:17.164832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 358/714] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:17.260779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-34c62396-4e12-429f-96ff-ac231c57a7f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments/343da168-8585-4ea1-bc0c-29e75b0c6bd2" status: 202 len: 0 microversion: 2.20 time: 0.448385 Sep 01 14:00:17.261371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 357/715] 10.222.0.50 () {60 vars in 1457 bytes} [Thu Sep 1 14:00:16 2022] DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments/343da168-8585-4ea1-bc0c-29e75b0c6bd2 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:00:17.271970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:17.272570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:17.273271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:17.274909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:17.279972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.280495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.281424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.282012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.282133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.282574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.282713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.282998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.283115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.283797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.284286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.284731 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.316729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9dc3ed2c-b765-4c61-8738-06ce136c4878 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049147 Sep 01 14:00:17.317316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 359/716] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:17 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:00:17.429914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:17.438316 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a0979a6b-53aa-4800-999a-a7c20d75ba65 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.170175 Sep 01 14:00:17.441897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 358/717] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:17 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:17.647879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:17.648491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:17.654571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.655049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.655537 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.656233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.656684 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.657107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] HTTP exception thrown: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Request method failure captured: Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 HTTP/1.1 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmVaIUV1sZ1FUTBVGQBvgfIMlUjZEa76od2HmAagPN_ZBZ670VhWyVv88yinZkiStz7yP6Z18Y1hZy-dSyapRyaBxqR11xXoSzPS94ieRptpOtYTf3argdr5iRfgG8OVsuicFE9P5Ouv-bLFR-86h9X7d6o9zxYetvfbppnxMztsCw Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:00:17.673489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}] Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5a441adf6eee4ba78992aafbbf02f1c8 Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. Sep 01 14:00:17.675541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '4cd192f7-8775-4aa6-b31c-55b0d16aa6c7'} Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:17.676462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. Sep 01 14:00:17.677941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:17.679291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Returning 404 to user: Instance 4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:17.679291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0fff00d0-85d2-42a5-ad0c-3fdaf4040af9 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7" status: 404 len: 111 microversion: 2.1 time: 0.029600 Sep 01 14:00:17.679291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 360/718] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:17 2022] GET /compute/v2.1/servers/4cd192f7-8775-4aa6-b31c-55b0d16aa6c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:17.682613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:17.683248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:17.690786 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.691497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.691943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.692824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:17.693495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:17.694086 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:17.723500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:00:18.107819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-aa2fec53-0887-4749-b13d-e60863984d58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 204 len: 0 microversion: 2.1 time: 0.428760 Sep 01 14:00:18.109414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 359/719] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:00:17 2022] DELETE /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:00:18.117544 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:18.118430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:18.125397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.125881 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.126397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.127093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.127588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.128084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.263445 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:18.271875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-37e3e8cf-efa3-4309-a091-ab357131f367 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.158201 Sep 01 14:00:18.272447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 361/720] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:18 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:18.329587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:18.331937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:18.337921 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.338399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.338824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.339539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.339983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.340399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.344662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:18.375061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-14b943ce-94c1-448f-bd85-43e956d6d27e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050115 Sep 01 14:00:18.375674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 360/721] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:18 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:00:18.458269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:18.458879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:18.465467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.466166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.466690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.467420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:18.468551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:18.469058 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:18.610130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:18.617851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a117d14f-5fac-45c2-aae5-c7ecb38f670d tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.163618 Sep 01 14:00:18.618418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 362/722] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:18 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:19.293489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:19.294104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:19.301919 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.302404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.302837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.303581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.304039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.304481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.391430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:19.393945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:19.402425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.403002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.403615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.404312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.404836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.405484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.435851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3e58c6b7-4999-43a1-87d7-62cf9bde7fd3 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048330 Sep 01 14:00:19.436441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 363/723] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:19 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:00:19.437981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:19.445751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ae8ddc4d-1b62-48e1-a4da-b1bda67fee58 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.156108 Sep 01 14:00:19.446314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 361/724] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:19 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:19.637669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:19.638278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:19.644304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.644789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.645222 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.645914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:19.646362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:19.646782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:19.777027 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:19.785589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e9225512-9558-44f6-983c-836ac3273141 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.151687 Sep 01 14:00:19.786161 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 364/725] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:19 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:20.449089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:20.451566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:20.458611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.459085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.459545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.460228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.460672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.461093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.466251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:20.466898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:20.473362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.473858 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.474300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.475020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.475504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.476003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.492551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cc0e9412-0cd7-484d-9766-c0123039d896 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047705 Sep 01 14:00:20.493112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 362/726] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:20 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:00:20.607729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:20.615766 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c8a5b4b6-90ae-438c-8c44-d1d1335fe584 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.153382 Sep 01 14:00:20.616341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 365/727] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:20 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:20.807832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:20.808442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:20.814941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.815441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.815868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.816547 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:20.816986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:20.817400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:20.948220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:20.956187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cb6e4339-bcf3-4354-b71c-b9287f53df90 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.152141 Sep 01 14:00:20.956769 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 363/728] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:20 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:21.506141 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:21.508198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:21.515121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.515640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.516073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:21.516764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.517213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.523058 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:21.547411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-167c2cd8-b4d6-4e04-9bb7-f90ade899e61 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Sep 01 14:00:21.549855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 366/729] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:21 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:00:21.636925 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:21.637543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:21.644569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.645047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.645478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:21.646168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.646623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.647038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:21.773462 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:21.781739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-808efa9f-5ad5-4565-8147-8be1b5d25c30 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.148600 Sep 01 14:00:21.782308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 364/730] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:21 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:21.980585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:21.981715 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:21.992735 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.993599 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.994360 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:21.995619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:21.996380 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:21.997055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.149405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:22.162405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-057b7800-e6c6-44da-889e-d2147bdc8824 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1363 microversion: 2.1 time: 0.187074 Sep 01 14:00:22.162405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 367/731] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:21 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:22.563094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:22.566095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:22.575788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.576527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.577282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.578202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.578851 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.579781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.672691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fb4f46e0-0a8c-4b9e-b239-2991a8897003 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.115551 Sep 01 14:00:22.682947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 365/732] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:00:22 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:22.769059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:22.769739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:22.776868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.777734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.778420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.779343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.779836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.780799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.808046 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:22.809558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:22.837229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.838853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.840220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:22.841525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:00:22.843708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:22.849807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:22.850971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.170909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-81014b52-400f-40ea-8d33-be94be58cc8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 204 len: 0 microversion: 2.20 time: 0.406008 Sep 01 14:00:23.176096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 368/733] 10.222.0.50 () {60 vars in 1280 bytes} [Thu Sep 1 14:00:22 2022] DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 14:00:23.184379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:23.185305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:23.189390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:23.195497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.196365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.197174 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.198394 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.198611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-63eb6669-65e8-4e2a-a5b6-83c397409160 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1520 microversion: 2.1 time: 0.398760 Sep 01 14:00:23.211522 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 366/734] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:22 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:23.211840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.211840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.212186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:23.212186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:23.222833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.222833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.222833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.222833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.238441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.238441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.386820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:23.397722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:23.399619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:23.400882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ad379f9e-9911-4a38-9d53-51adeae353f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.223083 Sep 01 14:00:23.401460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 369/735] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:23 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:23.456270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:23.466233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-537ee87f-d909-4c65-a384-69d5cb8756c0 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1549 microversion: 2.1 time: 0.265611 Sep 01 14:00:23.466855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 367/736] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:23 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:23.488367 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:23.488868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:23.495611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.496155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.496596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.497320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.497846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.498311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.514207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:23.600825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c145c5e6-e87e-43f4-85e2-e865c9f47b54 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116176 Sep 01 14:00:23.602005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 370/737] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 14:00:23 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:23.713339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f03e0d8-29d4-41d8-9275-86fb779cab41", "name": "network-vif-deleted", "tag": "55fca74a-4596-432e-a05f-27d0507f84b7"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:23.731274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:23.732113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:23.732850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:23.754884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] Creating event network-vif-deleted:55fca74a-4596-432e-a05f-27d0507f84b7 for instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 on hv-cinder-83976 Sep 01 14:00:23.763806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-16da2c23-41c5-40ac-8b49-8d789c01c7ce req-e13966f8-ddb6-4ae3-9291-f6e2449b9440 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056899 Sep 01 14:00:23.765396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 368/738] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:24.242090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:24.242894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:24.249437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:24.249926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:24.250355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:24.251100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:24.251580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:24.251993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:24.339790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:24.348982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-71a33986-e5ea-4a16-b009-39813446ea10 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1478 microversion: 2.1 time: 0.111930 Sep 01 14:00:24.349728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 371/739] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:24 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:24.427196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:24.428218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:24.435072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:24.435613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:24.436074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:24.436788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:24.437236 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:24.437652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:24.684755 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:24.696562 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:24.698488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:24.699782 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e21aaf15-00dd-4f4d-a97a-bdb703deb0b4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.277494 Sep 01 14:00:24.700350 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 369/740] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:24 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:25.379973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:25.380619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:25.387511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:25.388002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:25.388444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:25.389146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:25.389593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:25.390010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:25.476638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:25.487256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cee9ffb4-c162-4f62-9bf1-7be2dd5d42f1 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1478 microversion: 2.1 time: 0.111675 Sep 01 14:00:25.488091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 372/741] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:25 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1478 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:25.725787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:25.726691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:25.737311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:25.738051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:25.738628 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:25.739566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:25.740175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:25.740715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:25.815169 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ce52de-2a26-4f78-8ff8-a8239eaf5939", "tag": "b00b2c4e-5c8d-4210-be06-e5dd71e0a08f"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:25.832714 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:25.833629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:25.841817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:25.856925 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] Creating event network-changed:b00b2c4e-5c8d-4210-be06-e5dd71e0a08f for instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 on hv-cinder-83976 Sep 01 14:00:25.867120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-66c32ae5-cb2d-4339-83af-89895bf7c7d3 req-2bd52844-afbf-4fda-8779-dba4cc1a2b0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057804 Sep 01 14:00:25.868566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 373/742] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:25.965563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:25.982759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:25.986619 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:25.988987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2b0e2b8f-0ef0-40c2-8588-bcef3a39195e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.268129 Sep 01 14:00:25.990000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 370/743] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:25 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:26.512396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:26.513107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:26.520464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:26.520951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:26.521380 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:26.522575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:26.522575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:26.523269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:26.597366 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:26.611469 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-96567811-b872-4348-b275-7e370bccb0af tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1478 microversion: 2.1 time: 0.103650 Sep 01 14:00:26.612864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 374/744] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:26 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1478 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:27.011869 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:27.012480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:27.019274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:27.019806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:27.020852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:27.021558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:27.022006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:27.022423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:27.175425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:27.185784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:27.188431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:27.189797 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-55cb4f41-4958-40d7-b426-874f033527f6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.181744 Sep 01 14:00:27.190468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 371/745] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:27 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:27.634003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:27.634583 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:27.648563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:27.649307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:27.649844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:27.650679 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:27.651317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:27.651921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:27.695083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:27.695612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:27.696053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:27.696511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid 9f03e0d8-29d4-41d8-9275-86fb779cab41 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:27.769987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:27.778369 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2fd0320e-eec6-43b7-860b-b2285a8a081b tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1310 microversion: 2.1 time: 0.148432 Sep 01 14:00:27.779203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 375/746] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:27 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1310 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:28.213543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:28.214131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:28.221412 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:28.221883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:28.222308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:28.223039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:28.223507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:28.223923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:28.427602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:28.439705 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:28.443689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:28.446143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-171ede49-fefc-4a7d-be08-e29780c043f0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1723 microversion: 2.20 time: 0.236489 Sep 01 14:00:28.456517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 372/747] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:28 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:28.800430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:28.801178 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:28.807869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:28.809072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:28.809072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:28.809741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:28.810139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:28.810353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:28.861171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:28.861667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:28.862107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:28.863034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lazy-loading 'fault' on Instance uuid 9f03e0d8-29d4-41d8-9275-86fb779cab41 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:28.945942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a441adf6eee4ba78992aafbbf02f1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c45ef65901048fe8966f332a04fb6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:28.959638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bbb1f518-1738-49a9-9378-af7527be80ff tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 200 len: 1310 microversion: 2.1 time: 0.162712 Sep 01 14:00:28.961065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 376/748] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:28 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 1310 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:29.402295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f4b0f-c912-498b-a106-05ad58398708", "name": "network-vif-deleted", "tag": "c70191ab-747d-4b0e-b61d-a58948d56799"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:29.417662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:29.419846 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:29.420623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:29.434485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] Creating event network-vif-deleted:c70191ab-747d-4b0e-b61d-a58948d56799 for instance b96f4b0f-c912-498b-a106-05ad58398708 on hv-cinder-83976 Sep 01 14:00:29.441780 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-bf56c6d1-4800-4b8c-ae88-16f141a01954 req-1b0d6f03-fb53-4010-9c6f-53ea886e2cf5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141814 Sep 01 14:00:29.443039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 373/749] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:29.477197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:29.478685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:29.490585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:29.491138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:29.491611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:29.492432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:29.493014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:29.493755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:29.583555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:29.606702 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:29.610751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:29.613032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-748efe4e-c9cb-4aef-956e-a8f393cd0e73 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1656 microversion: 2.20 time: 0.145052 Sep 01 14:00:29.614248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 377/750] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:29 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:29.982060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:29.983014 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] [instance: 9f03e0d8-29d4-41d8-9275-86fb779cab41] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:29.991698 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:29.992233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:29.992702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:29.993418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:29.993901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:29.994714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:30.012018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] HTTP exception thrown: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Request method failure captured: Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 HTTP/1.1 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmVaIUV1sZ1FUTBVGQBvgfIMlUjZEa76od2HmAagPN_ZBZ670VhWyVv88yinZkiStz7yP6Z18Y1hZy-dSyapRyaBxqR11xXoSzPS94ieRptpOtYTf3argdr5iRfgG8OVsuicFE9P5Ouv-bLFR-86h9X7d6o9zxYetvfbppnxMztsCw Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:30.017540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c45ef65901048fe8966f332a04fb6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c45ef65901048fe8966f332a04fb6c9"}]}] Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 2c45ef65901048fe8966f332a04fb6c9 Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1086889755 Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5a441adf6eee4ba78992aafbbf02f1c8 Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1086889755-project Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. Sep 01 14:00:30.019307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '9f03e0d8-29d4-41d8-9275-86fb779cab41'} Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:30.020247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. Sep 01 14:00:30.021691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.022969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] Returning 404 to user: Instance 9f03e0d8-29d4-41d8-9275-86fb779cab41 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:30.022969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-31725298-e8ae-4269-a967-544a14504855 tempest-ServerRescueNegativeTestJSON-1086889755 tempest-ServerRescueNegativeTestJSON-1086889755-project] 10.222.0.50 "GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41" status: 404 len: 111 microversion: 2.1 time: 0.038775 Sep 01 14:00:30.022969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 374/751] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:29 2022] GET /compute/v2.1/servers/9f03e0d8-29d4-41d8-9275-86fb779cab41 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:30.657062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:30.658148 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:30.667761 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:30.668481 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:30.669204 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:30.670721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:30.671867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:30.672713 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:30.742016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:30.743624 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:30.745157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:30.746323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lazy-loading 'fault' on Instance uuid b96f4b0f-c912-498b-a106-05ad58398708 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:00:30.818008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:30.830025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:30.831985 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:30.833570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e51eda1a-fb85-4c6f-ae6d-a872f4458983 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 200 len: 1372 microversion: 2.20 time: 0.182430 Sep 01 14:00:30.839528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 378/752] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:30 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:31.863036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:31.865307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:31.874519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:31.875299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:31.876005 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:31.876885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:31.877756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:31.878288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:31.902252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 HTTP/1.1 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:31.904576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:00:31.914516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'b96f4b0f-c912-498b-a106-05ad58398708'} Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:31.915328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:00:31.916670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.917838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:31.917838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-956526d5-04e9-4d9a-b0d2-344bdffd3437 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 404 len: 111 microversion: 2.20 time: 0.049595 Sep 01 14:00:31.917838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 375/753] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:31 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:00:31.922174 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f5103a06-9526-4c11-89b0-09421c3a645f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '.version_select at 0x7f980eabfc10>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:32.042696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f5103a06-9526-4c11-89b0-09421c3a645f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062572916" status: 204 len: 0 microversion: 2.20 time: 0.125016 Sep 01 14:00:32.045510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 379/754] 10.222.0.50 () {60 vars in 1262 bytes} [Thu Sep 1 14:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062572916 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:00:33.300868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-556b30b3-9cb3-4d99-9b63-0a67b0f9f2a6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: .version_select at 0x7f980ec5e0d0>, body: {"keypair": {"name": "tempest-keypair-78470436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlQT8KXIz9Qg57hLWjIZvAijPwh64Mh77+j0ndK2CRu9ejZmACMyShKSeIQWttcISqXnkxGlxcQneFIthne08FCRumd8J1EbuFEBBkF9mT3OFOdLcE7+pjQer+wmB18Zg=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:33.332144 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-556b30b3-9cb3-4d99-9b63-0a67b0f9f2a6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:33.348806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-556b30b3-9cb3-4d99-9b63-0a67b0f9f2a6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for user 658108c26fb74eba911e249819f8b290 and project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:33.500453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-556b30b3-9cb3-4d99-9b63-0a67b0f9f2a6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.206787 Sep 01 14:00:33.502308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 376/755] 10.222.0.50 () {62 vars in 1200 bytes} [Thu Sep 1 14:00:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 14:00:36.949228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-333541551", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4da6191a-4859-4f2e-959b-f5552b48d48b"}], "security_groups": [{"name": "tempest-securitygroup--329621231"}], "key_name": "tempest-keypair-78470436", "user_data": "}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:37.122776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] validate_networks() for [('4da6191a-4859-4f2e-959b-f5552b48d48b', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:37.620756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:37.621085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:37.621792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:37.622486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:37.623164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:37.638894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:37.640069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:37.640868 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:37.642349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:37.643170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:37.643970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:37.671120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:37.677125 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Getting quotas for user 658108c26fb74eba911e249819f8b290 and project a5ccb0fe770a41e99a822a6d4f88d401. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:37.692249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:37.695260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:37.876526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a222bc27-2303-409f-89f7-699a11221548 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.936954 Sep 01 14:00:37.877966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 380/756] 10.222.0.50 () {62 vars in 1188 bytes} [Thu Sep 1 14:00:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 14:00:37.899043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:37.901296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:38.004954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:38.018600 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:38.021978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:38.024598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e1b61d4a-cc39-495b-9ea1-66be77ca52fa tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1279 microversion: 2.20 time: 0.133848 Sep 01 14:00:38.028085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 377/757] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:37 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:38.466904 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-789bf87d-7222-46cd-985d-f491a3292953 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Action: 'create', calling method: .version_select at 0x7f980eabf670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-252159455"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:39.064056 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:39.064880 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:39.073407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:39.074524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:39.075189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:39.076121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:39.076593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:39.077062 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:39.160534 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:39.171191 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:39.172793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:39.174049 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a11f7eef-c5d1-4dcb-9a43-222a2787ee16 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1283 microversion: 2.20 time: 0.115442 Sep 01 14:00:39.174626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 378/758] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:39 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:39.382956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-789bf87d-7222-46cd-985d-f491a3292953 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.086099 Sep 01 14:00:39.383998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 381/759] 10.222.0.50 () {60 vars in 1155 bytes} [Thu Sep 1 14:00:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1089 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:00:39.398138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d182dbca-6968-4e65-8f6f-405cb9abb937 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ec5fdc0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:39.461858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d182dbca-6968-4e65-8f6f-405cb9abb937 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 200 len: 344 microversion: 2.1 time: 0.068334 Sep 01 14:00:39.468778 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 379/760] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:39 2022] GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:40.198216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:40.199050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:40.202686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:40.209704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:40.210258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:40.210895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:40.211867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:40.212459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:40.213036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:40.286390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:40.298565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:40.300084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:40.301261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ad036dfc-5e3e-4d8b-8298-68f6469ddef5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1331 microversion: 2.20 time: 0.107897 Sep 01 14:00:40.301836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 382/761] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:40 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:40.478639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-31e3259f-0905-4ebd-bbd0-032ab5a85677 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ebe5790>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:40.563544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-31e3259f-0905-4ebd-bbd0-032ab5a85677 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 200 len: 345 microversion: 2.1 time: 0.089930 Sep 01 14:00:40.564571 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 380/762] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:40 2022] GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:40.582529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a7cf360a-7b00-4a8c-a821-5a1d02e17e03 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Action: 'create', calling method: .version_select at 0x7f980ead1ee0>, body: {"snapshot": {"volume_id": "d2bf4dd0-4f9d-4c22-9975-c978e978a11a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-940499329"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:41.236234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a7cf360a-7b00-4a8c-a821-5a1d02e17e03 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.660015 Sep 01 14:00:41.238485 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 383/763] 10.222.0.50 () {60 vars in 1162 bytes} [Thu Sep 1 14:00:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:41.255312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3a83808c-60da-4b81-9cda-a33e78d98318 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eaafc10>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:41.290575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3a83808c-60da-4b81-9cda-a33e78d98318 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 286 microversion: 2.1 time: 0.040524 Sep 01 14:00:41.291436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 381/764] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:41 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:41.302668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a4d149b7-4e57-4eac-8069-6f9955f4f1cc tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb33670>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:41.330625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:41.332005 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:41.336274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:41.343510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a4d149b7-4e57-4eac-8069-6f9955f4f1cc tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043650 Sep 01 14:00:41.344103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:41.344581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 384/765] 10.222.0.50 () {58 vars in 1140 bytes} [Thu Sep 1 14:00:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:41.345072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:41.346099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:41.347775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:41.349233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:41.350262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:41.364623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dcc5bf35-ef56-4ca6-8aa8-d073e37c6bd6 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb0cb80>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:41.441586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dcc5bf35-ef56-4ca6-8aa8-d073e37c6bd6 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 286 microversion: 2.1 time: 0.084027 Sep 01 14:00:41.443467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 385/766] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:41 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:41.456966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:41.467764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:41.469656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:41.471536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-71913a61-da1a-4182-b6f2-3f83e868566b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1337 microversion: 2.20 time: 0.148852 Sep 01 14:00:41.472292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 382/767] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:41 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1337 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:42.455436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cc7d78fc-5e8a-42a4-9a8d-58008a9587eb tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb93f70>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:42.501323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cc7d78fc-5e8a-42a4-9a8d-58008a9587eb tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 286 microversion: 2.1 time: 0.050241 Sep 01 14:00:42.502203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 386/768] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:42 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:42.504458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:42.505098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:42.512802 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:42.513300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:42.513729 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:42.514974 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:42.515452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:42.515872 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:42.665089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:42.679018 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:42.680491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:42.681636 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cc770014-8e40-4d3d-b4cf-b450859bbdb1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.181907 Sep 01 14:00:42.682223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 383/769] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:42 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:43.515778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cb348a25-8229-4cc0-a43b-29d656dcdde0 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eabf310>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:43.571261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cb348a25-8229-4cc0-a43b-29d656dcdde0 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 286 microversion: 2.1 time: 0.059705 Sep 01 14:00:43.572542 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 387/770] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:43 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:43.708750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:43.709647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:43.722206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:43.723054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:43.723792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:43.725393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:43.726219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:43.726967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:43.756505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:43.937997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:43.948222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:43.949956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:43.951609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-004918a5-fd92-4969-ae3c-eb90624a06f4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.250133 Sep 01 14:00:43.952281 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 384/771] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:43 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:44.350329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:44.365980 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:44.366696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:44.367787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:44.382359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] Creating event network-changed:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:00:44.389212 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-94a77916-829c-4f25-a538-46fba00c3729 req-dc31ec9c-7560-41d0-90e6-ee1715db7a4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042998 Sep 01 14:00:44.390076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 388/772] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:44.587906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d1f4ffba-b292-41e0-ab81-df120808cd2c tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb71280>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:44.627009 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d1f4ffba-b292-41e0-ab81-df120808cd2c tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 287 microversion: 2.1 time: 0.042852 Sep 01 14:00:44.630330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 385/773] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:44 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:44.647544 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1ac3d568-cc75-4a8a-83c5-121d4493c43d tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eabf9d0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:44.911304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1ac3d568-cc75-4a8a-83c5-121d4493c43d tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 202 len: 0 microversion: 2.1 time: 0.270344 Sep 01 14:00:44.911554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 389/774] 10.222.0.50 () {58 vars in 1254 bytes} [Thu Sep 1 14:00:44 2022] DELETE /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:00:44.925213 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ddb642e4-47f1-4a4d-bd0c-339de6372faa tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb5a280>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:44.983509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:44.985975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:44.993142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ddb642e4-47f1-4a4d-bd0c-339de6372faa tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 200 len: 286 microversion: 2.1 time: 0.072305 Sep 01 14:00:44.994414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 386/775] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:44 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:45.002103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:45.003069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:45.003697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:45.004527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:45.005198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:45.005720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:45.285823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:45.299769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:45.303199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:45.305838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d064b5ab-1941-4ee5-bed0-6ceb2085a510 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.333259 Sep 01 14:00:45.306866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 390/776] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:44 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:46.011178 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-286eea7c-4e03-4e91-a7f1-ec50e04e5db1 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb0d4c0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:46.040290 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-286eea7c-4e03-4e91-a7f1-ec50e04e5db1 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] HTTP exception thrown: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-286eea7c-4e03-4e91-a7f1-ec50e04e5db1 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Request method failure captured: Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e HTTP/1.1 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELsGeAzYaIPyoKoH2JVwmWth5Bo5JtRp8hWvRYDVxgf44dd2X3uNBJGgL61S9HMvTsFvPAWB9IPXurHjXGq5s7Mwn3CPPgPrjzoJLtAz3YCHNOkdtXMZWF3K-QPrWNm5qfeak6JSST3lP_P0OQqiwAle9ptjnMbizwcRYqZWWCw_8nE Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:46.042507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b233c06742c3483080047c0bd9abea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b233c06742c3483080047c0bd9abea34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}] Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: db73be5adb2d4ab8a003f55b56475e9a Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'b49da92c-15b7-4e6d-9f31-e1a291d72b4e'} Sep 01 14:00:46.045217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. (HTTP 404) (Request-ID: req-507a8e75-d29c-4f8b-b918-a0e7b24feca1) Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.046722 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:46.048942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 14:00:46.051033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-286eea7c-4e03-4e91-a7f1-ec50e04e5db1 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Returning 404 to user: Snapshot b49da92c-15b7-4e6d-9f31-e1a291d72b4e could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:46.053414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-286eea7c-4e03-4e91-a7f1-ec50e04e5db1 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e" status: 404 len: 111 microversion: 2.1 time: 0.037402 Sep 01 14:00:46.054837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 387/777] 10.222.0.50 () {58 vars in 1251 bytes} [Thu Sep 1 14:00:46 2022] GET /compute/v2.1/os-snapshots/b49da92c-15b7-4e6d-9f31-e1a291d72b4e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:00:46.056934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4c43d606-efb9-499f-8555-57ae7c393cb7 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ead1700>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:46.297572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4c43d606-efb9-499f-8555-57ae7c393cb7 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 202 len: 0 microversion: 2.1 time: 0.243950 Sep 01 14:00:46.297572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 391/778] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:00:46 2022] DELETE /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:00:46.306469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b42620d9-54e4-439a-afc5-4ef5cf224d4b tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980eb5a1f0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:46.337831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:46.338789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:46.349446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:46.350292 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:46.351078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:46.352262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:46.353202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:46.353950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:46.377281 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b42620d9-54e4-439a-afc5-4ef5cf224d4b tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 200 len: 344 microversion: 2.1 time: 0.075121 Sep 01 14:00:46.389913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 388/779] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:46 2022] GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:46.566105 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:46.579819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:46.585191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:46.585191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-585cc03b-2e44-44ac-8556-3002a5b666fd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.252340 Sep 01 14:00:46.585191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 392/780] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:46 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:47.397545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6d31ade2-7e76-4c1d-9aa0-f2ecce4f8a85 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ebe5c10>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:47.431151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-6d31ade2-7e76-4c1d-9aa0-f2ecce4f8a85 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] HTTP exception thrown: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6d31ade2-7e76-4c1d-9aa0-f2ecce4f8a85 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Request method failure captured: Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a HTTP/1.1 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELsGeAzYaIPyoKoH2JVwmWth5Bo5JtRp8hWvRYDVxgf44dd2X3uNBJGgL61S9HMvTsFvPAWB9IPXurHjXGq5s7Mwn3CPPgPrjzoJLtAz3YCHNOkdtXMZWF3K-QPrWNm5qfeak6JSST3lP_P0OQqiwAle9ptjnMbizwcRYqZWWCw_8nE Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:47.433397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b233c06742c3483080047c0bd9abea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b233c06742c3483080047c0bd9abea34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}] Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: db73be5adb2d4ab8a003f55b56475e9a Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'd2bf4dd0-4f9d-4c22-9975-c978e978a11a'} Sep 01 14:00:47.437505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. (HTTP 404) (Request-ID: req-ef97e66c-5e4d-40d2-a055-676a46f5f4f2) Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.438441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:47.439723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:00:47.440799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6d31ade2-7e76-4c1d-9aa0-f2ecce4f8a85 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Returning 404 to user: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6d31ade2-7e76-4c1d-9aa0-f2ecce4f8a85 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 404 len: 109 microversion: 2.1 time: 0.042152 Sep 01 14:00:47.441916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 389/781] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:47 2022] GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:47.455397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c8d9e781-c63a-43a0-9bf8-75e12940fbbd tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ed461f0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:47.490592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-c8d9e781-c63a-43a0-9bf8-75e12940fbbd tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] HTTP exception thrown: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c8d9e781-c63a-43a0-9bf8-75e12940fbbd tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Request method failure captured: Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a HTTP/1.1 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELsGeAzYaIPyoKoH2JVwmWth5Bo5JtRp8hWvRYDVxgf44dd2X3uNBJGgL61S9HMvTsFvPAWB9IPXurHjXGq5s7Mwn3CPPgPrjzoJLtAz3YCHNOkdtXMZWF3K-QPrWNm5qfeak6JSST3lP_P0OQqiwAle9ptjnMbizwcRYqZWWCw_8nE Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:00:47.494741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b233c06742c3483080047c0bd9abea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b233c06742c3483080047c0bd9abea34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}] Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: db73be5adb2d4ab8a003f55b56475e9a Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'd2bf4dd0-4f9d-4c22-9975-c978e978a11a'} Sep 01 14:00:47.497244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. (HTTP 404) (Request-ID: req-aa5aecd5-b392-429c-bfb1-af74da9901bd) Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.499226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:47.501423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:00:47.503779 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c8d9e781-c63a-43a0-9bf8-75e12940fbbd tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Returning 404 to user: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c8d9e781-c63a-43a0-9bf8-75e12940fbbd tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 404 len: 109 microversion: 2.1 time: 0.046483 Sep 01 14:00:47.505902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 393/782] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:00:47 2022] DELETE /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:47.509201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-78e6c6f8-a229-48e0-92f8-3c00eb145364 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Calling method '.version_select at 0x7f980ec5f040>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:47.554182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-78e6c6f8-a229-48e0-92f8-3c00eb145364 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] HTTP exception thrown: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-78e6c6f8-a229-48e0-92f8-3c00eb145364 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Request method failure captured: Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a HTTP/1.1 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELsGeAzYaIPyoKoH2JVwmWth5Bo5JtRp8hWvRYDVxgf44dd2X3uNBJGgL61S9HMvTsFvPAWB9IPXurHjXGq5s7Mwn3CPPgPrjzoJLtAz3YCHNOkdtXMZWF3K-QPrWNm5qfeak6JSST3lP_P0OQqiwAle9ptjnMbizwcRYqZWWCw_8nE Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:00:47.556575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b233c06742c3483080047c0bd9abea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b233c06742c3483080047c0bd9abea34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b233c06742c3483080047c0bd9abea34"}]}] Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: b233c06742c3483080047c0bd9abea34 Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006884679 Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: db73be5adb2d4ab8a003f55b56475e9a Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006884679-project Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'd2bf4dd0-4f9d-4c22-9975-c978e978a11a'} Sep 01 14:00:47.559483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. (HTTP 404) (Request-ID: req-d04363a7-8bbc-49ef-89e1-b9147816a01d) Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.561510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:47.563027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:00:47.564527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-78e6c6f8-a229-48e0-92f8-3c00eb145364 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] Returning 404 to user: Volume d2bf4dd0-4f9d-4c22-9975-c978e978a11a could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-78e6c6f8-a229-48e0-92f8-3c00eb145364 tempest-VolumesSnapshotsTestJSON-2006884679 tempest-VolumesSnapshotsTestJSON-2006884679-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a" status: 404 len: 109 microversion: 2.1 time: 0.053758 Sep 01 14:00:47.566945 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 390/783] 10.222.0.50 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:47 2022] GET /compute/v2.1/os-volumes/d2bf4dd0-4f9d-4c22-9975-c978e978a11a => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:47.621429 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:47.623237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:47.631640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:47.632447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:47.633163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:47.634326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:47.635032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:47.635778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:47.656864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:47.686780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:47.804954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:47.820587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:47.823536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:47.829468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c64ebf71-ef7b-44a7-92e0-0dcb13cca567 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.210687 Sep 01 14:00:47.829468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 394/784] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:47 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:48.664531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:48.672928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:48.692549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:48.693301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:48.694757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:48.713640 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] Creating event network-vif-plugged:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:00:48.723351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-efdf04c1-86c4-4b7a-870d-4696753164bc req-e22a1a5c-ff06-4643-a7bd-cf3b44cda1e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059623 Sep 01 14:00:48.724392 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 391/785] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:48.851138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:48.853921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:48.859461 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:48.859924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:48.860367 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:48.861100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:48.861562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:48.861989 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:49.189275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:49.202424 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:49.204838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:49.206657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-73c3a811-6527-4108-93ea-ec402e02e1a2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.359399 Sep 01 14:00:49.207927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 395/786] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:48 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:50.237466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:50.238279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:50.248720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:50.249562 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:50.250431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:50.251695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:50.252456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:50.253157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:50.459486 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:50.465178 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:50.466890 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:50.468271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-39ef4319-0a95-41cb-85d2-a66115c365b9 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1404 microversion: 2.20 time: 0.236799 Sep 01 14:00:50.468957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 392/787] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:50 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:51.504562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:51.505294 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:51.513540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:51.514795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:51.515571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:51.516757 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:51.517474 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:51.518176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:51.695102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:51.708816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:51.712848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:51.715147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cc273b14-278d-4c49-b792-cc9f6dfdb14d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1595 microversion: 2.20 time: 0.214230 Sep 01 14:00:51.716534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 396/788] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:00:51 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1595 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:00:51.752482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:51.752482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:51.761734 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:51.762540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:51.763279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:51.765028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:51.765791 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:51.766372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:51.871572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c6914f42-4f43-4add-bde8-dfcce91b4ebe tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127819 Sep 01 14:00:51.872331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 393/789] 10.222.0.50 () {60 vars in 1316 bytes} [Thu Sep 1 14:00:51 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:00:53.358297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:53.374645 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:53.375679 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:53.376597 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:53.396536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] Creating event network-changed:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:00:53.403468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-42dedb21-2f14-4e92-b5fd-425e10d8ca08 req-27668582-a6dd-4403-95b4-a461673488d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052759 Sep 01 14:00:53.404288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 397/790] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:01.272863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:01.273613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:01.280591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.281395 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.281912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:01.282867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.283527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.284010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:01.312913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a25d36ae-a0ee-41d0-8a7d-4fcff18b708c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/ips" status: 200 len: 145 microversion: 2.1 time: 0.045105 Sep 01 14:01:01.313606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 394/791] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:01:01 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:03.096071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e08c631b-c333-4641-9fcd-8af00f6c39bd"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:03.099062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:03.106175 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.106678 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.107121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.107976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.108440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.108871 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.112126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=94 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:06.694525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3f7163f9-68b5-4a9d-a8ac-375a208c3ac5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.604670 Sep 01 14:01:06.695886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 398/792] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:01:03 2022] POST /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 194 bytes in 3607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:15.446118 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:15.450228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:15.454783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=13 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:15.455949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=19 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:15.466168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.467612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.468396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.469631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.470254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.471081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.528602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-39f9ae88-49a0-4339-845b-c0e0be92bd91 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086195 Sep 01 14:01:15.528602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 395/793] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:01:15 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:15.540565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=17 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:15.548727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:15.549792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:15.561190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.562049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.562822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.564144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.564952 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.565717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.611224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ef9d6d6d-c5d3-4445-b39e-4606a6126986 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd" status: 200 len: 194 microversion: 2.1 time: 0.070284 Sep 01 14:01:15.611224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 399/794] 10.222.0.50 () {58 vars in 1413 bytes} [Thu Sep 1 14:01:15 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:17.525774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeb8849d-4f1d-4d2b-a291-ac28f4b99d5c"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:17.528268 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:17.537325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.541244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.541244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.541244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.541244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.541654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.334200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-38d25f5b-17ce-41f4-9c45-fb80976bd98e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "POST /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812716 Sep 01 14:01:18.334822 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 396/795] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:01:17 2022] POST /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:26.993210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:26.993210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:27.001266 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:27.006047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.006796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.007231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.007970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.008414 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.009023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.042346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-da5a080e-dd1a-4904-97dc-525f5c597b29 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062241 Sep 01 14:01:27.042934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 400/796] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:01:26 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:27.207068 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:27.208003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:27.219402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.220265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.221039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.222322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.223864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.224286 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.283194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c6865348-de7c-4990-9574-2264c501d8be tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd" status: 200 len: 194 microversion: 2.1 time: 0.083139 Sep 01 14:01:27.289975 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 397/797] 10.222.0.50 () {58 vars in 1413 bytes} [Thu Sep 1 14:01:27 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:27.295911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:27.297256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:27.304425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.305085 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.305593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.306381 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.306908 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.307468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.404057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lazy-loading 'services' on Instance uuid 97ce52de-2a26-4f78-8ff8-a8239eaf5939 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:01:27.696078 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d2dea76e-0154-4284-89d6-d759708e66ba tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd" status: 202 len: 0 microversion: 2.1 time: 0.404113 Sep 01 14:01:27.696944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 401/798] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:01:27 2022] DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/e08c631b-c333-4641-9fcd-8af00f6c39bd => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:01:28.255287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:28.256574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:28.260529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:28.276641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.277330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.278029 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.281678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.282927 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.283920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.289321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.290040 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.290655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.306849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] Creating event network-changed:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 14:01:28.314241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-4b151086-7485-4abd-bf53-4405ed7cd764 req-d7330c01-a502-44b6-98c6-ac17ec4d2ce4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065732 Sep 01 14:01:28.315137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 402/799] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:28.345720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:01:28.732887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-73fd8138-4727-409b-a957-331f11c6db9e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 204 len: 0 microversion: 2.1 time: 0.486983 Sep 01 14:01:28.737662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 398/800] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:01:28 2022] DELETE /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:01:28.754229 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:28.756803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:28.769634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.770461 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.771223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.772592 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.773636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.774655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.243760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:29.256661 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-96e27c07-7f7c-4474-b501-db7474b9c732 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.515516 Sep 01 14:01:29.257878 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 403/801] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:28 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:29.996976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:29.998238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:30.013041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.013041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.013041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.013041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.013671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.013671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.034972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:30.035749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:30.042609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.043199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.043669 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.044445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.044911 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.045409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.084458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cc0cd16b-c795-4cd8-8504-e4b1b2180f09 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/ips" status: 200 len: 150 microversion: 2.20 time: 0.309081 Sep 01 14:01:30.085082 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 399/802] 10.222.0.50 () {60 vars in 1289 bytes} [Thu Sep 1 14:01:29 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/ips => generated 150 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:01:30.216978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e6c1b90d-1138-4c67-bd89-3fd095b010f9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/aeb8849d-4f1d-4d2b-a291-ac28f4b99d5c" status: 200 len: 194 microversion: 2.1 time: 0.224100 Sep 01 14:01:30.217938 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 404/803] 10.222.0.50 () {58 vars in 1413 bytes} [Thu Sep 1 14:01:29 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/aeb8849d-4f1d-4d2b-a291-ac28f4b99d5c => generated 194 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:30.237596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:30.239492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:30.247007 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.248463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.248934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.249702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.250399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.251556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.291455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:30.292242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:30.299971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.300472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.300911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.301637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.302086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.302511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.528859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:30.543785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d24a168d-9892-4f7d-acb5-155aaedee375 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1571 microversion: 2.1 time: 0.256912 Sep 01 14:01:30.545257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 405/804] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:30 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1571 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:30.767087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lazy-loading 'services' on Instance uuid 97ce52de-2a26-4f78-8ff8-a8239eaf5939 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:01:31.085116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c70b2-5b53-49ff-8dd7-4548972014f7", "name": "network-vif-deleted", "tag": "49debff1-8544-4fd7-af5f-92339b39f545"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:31.096548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.097057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.097481 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.130594 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] Creating event network-vif-deleted:49debff1-8544-4fd7-af5f-92339b39f545 for instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 on hv-cinder-83976 Sep 01 14:01:31.134139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-89c0bd1c-8c63-47d8-ad19-02c4cdd12ebd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/aeb8849d-4f1d-4d2b-a291-ac28f4b99d5c" status: 202 len: 0 microversion: 2.1 time: 0.904638 Sep 01 14:01:31.135225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 400/805] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:01:30 2022] DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments/aeb8849d-4f1d-4d2b-a291-ac28f4b99d5c => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:01:31.149526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-2876222c-3e83-4cb1-87b2-a4956867511b req-00d26d2c-ca11-4129-bd82-1f75081ac4d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069232 Sep 01 14:01:31.159912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 406/806] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:31.566169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:31.566867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:31.573686 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.574238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.574709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.575564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.576078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.576535 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.664354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:31.674316 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b69c07cb-0602-4ac3-82fe-764a9c29e146 tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1220 microversion: 2.1 time: 0.112217 Sep 01 14:01:31.675019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 401/807] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:31 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:32.697955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:32.698748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:32.705784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:32.706279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:32.706711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:32.707507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:32.707964 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:32.708386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:32.749614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:32.750101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:32.750538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:32.750982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lazy-loading 'fault' on Instance uuid fb5c70b2-5b53-49ff-8dd7-4548972014f7 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:01:32.807700 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3043eb81894f4525ac2d153da8bd3e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872714a31bdf46ddad040f1bc4b659da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:32.817766 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f51f2c33-01d1-47d2-97bd-317f5c04673e tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 200 len: 1225 microversion: 2.1 time: 0.124752 Sep 01 14:01:32.818352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 407/808] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:32 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:33.218647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:33.219533 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.227548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.228169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.228650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.232790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.232790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.232790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.257612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lazy-loading 'flavor' on Instance uuid 89a059e6-9ac3-4140-a725-5092e3a4a936 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:01:33.505354 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.509135 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.520425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.521214 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.521993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.523075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.523931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.524659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.559206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d430a5a1-43b0-4edb-acb1-80252c491762 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061283 Sep 01 14:01:33.559790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 408/809] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:01:33 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:01:33.699313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.702865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.713069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.713069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.713069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.713069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.713433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.713433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.757586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-122d60b1-18a9-4864-b2ac-261360855f4c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062152 Sep 01 14:01:33.758746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 409/810] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:01:33 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:01:33.845524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.846961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] [instance: fb5c70b2-5b53-49ff-8dd7-4548972014f7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.857409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.859252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.859252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.860426 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.860988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.861553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.878172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] HTTP exception thrown: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Request method failure captured: Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 HTTP/1.1 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELm81DLaSvlLZzQ3sP4td69jWng2LEEa92u5dyr-P2fyAyt57WdvsUBFNZkoAjExZkVucoJ_9xuZDVvqsdXJ_z0Dg8E0Ifz6uzuZ9TElbBwwp6Lzr9RhR4EFiqY5ZuPXa4q-LeOgxBKp27B8BHZC0Gc3q6q0A0k8ezEwnu-GN6Ljh28 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 872714a31bdf46ddad040f1bc4b659da Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-TestShelveInstance-2079974180 Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:01:33.880103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/872714a31bdf46ddad040f1bc4b659da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_872714a31bdf46ddad040f1bc4b659da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/872714a31bdf46ddad040f1bc4b659da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/872714a31bdf46ddad040f1bc4b659da"}]}] Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-TestShelveInstance-2079974180 Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 872714a31bdf46ddad040f1bc4b659da Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-TestShelveInstance-2079974180 Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-TestShelveInstance-2079974180-project Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 3043eb81894f4525ac2d153da8bd3e2d Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-TestShelveInstance-2079974180-project Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. Sep 01 14:01:33.889770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'fb5c70b2-5b53-49ff-8dd7-4548972014f7'} Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:33.892193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. Sep 01 14:01:33.894867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:33.898033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Returning 404 to user: Instance fb5c70b2-5b53-49ff-8dd7-4548972014f7 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:33.898033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-39553e38-9a86-4db3-8c1e-049a89ce82ca tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7" status: 404 len: 111 microversion: 2.1 time: 0.042688 Sep 01 14:01:33.898033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 410/811] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:33 2022] GET /compute/v2.1/servers/fb5c70b2-5b53-49ff-8dd7-4548972014f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:01:33.898033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.898033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.899016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.899016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.899016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.899016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.899988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.899988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.912817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-be623a94-d2f6-412b-ae9d-827e91e86765 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/action" status: 202 len: 0 microversion: 2.20 time: 0.698996 Sep 01 14:01:33.913904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 402/812] 10.222.0.50 () {62 vars in 1319 bytes} [Thu Sep 1 14:01:33 2022] POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:01:33.932354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.933237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.941927 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.942757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.943410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.944237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.944770 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.945444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.952128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:01:34.181846 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:34.192449 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:34.194529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:34.196113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7c9a63c0-38c1-4096-82fe-fe9b7bded903 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.271302 Sep 01 14:01:34.197043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 403/813] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:33 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:34.318275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-94ef0b3b-1414-4bed-9077-f67e3e63c01c tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] Calling method '.version_select at 0x7f980eb5a820>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:34.375453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9346626f-2b10-4d39-8a6f-eafd493a0487 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 204 len: 0 microversion: 2.1 time: 0.490830 Sep 01 14:01:34.377609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 411/814] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:01:33 2022] DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:01:34.387323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:34.388114 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:34.396506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:34.396999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:34.397452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:34.398277 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:34.398736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:34.399160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:34.463446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-94ef0b3b-1414-4bed-9077-f67e3e63c01c tempest-TestShelveInstance-2079974180 tempest-TestShelveInstance-2079974180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1817013721" status: 202 len: 0 microversion: 2.1 time: 0.149692 Sep 01 14:01:34.464177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 404/815] 10.222.0.50 () {58 vars in 1254 bytes} [Thu Sep 1 14:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1817013721 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:01:34.627545 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:34.639341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4f4aa803-e0f8-4a60-9acc-94a435285430 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1673 microversion: 2.1 time: 0.255489 Sep 01 14:01:34.640232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 412/816] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:34 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:35.224934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:35.225934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:35.238965 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:35.239886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:35.240664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:35.241957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:35.242647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:35.243427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:35.413935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:35.424861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:35.426984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:35.428249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b1b3dfac-b430-43a7-96c4-0131dc774364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.211100 Sep 01 14:01:35.429319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 405/817] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:35 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:35.670203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:35.671619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:35.678497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:35.678995 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:35.679472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:35.680248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:35.680760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:35.681198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:35.860764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:35.870020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-86076a3c-33a9-42b6-9be1-65d9f1984c84 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1673 microversion: 2.1 time: 0.203743 Sep 01 14:01:35.870604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 413/818] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:35 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:36.455917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:36.457262 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:36.465181 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:36.465671 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:36.466322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:36.467247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:36.468470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:36.469095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:36.893811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:36.894536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:36.906527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:36.909024 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:36.909563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:36.910333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:36.910800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:36.911228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:36.960593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:36.974856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:36.978617 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:36.978934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-8c4dce31-587e-4b44-8a4d-a532647a2fd6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.526880 Sep 01 14:01:36.979717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 406/819] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:36 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:37.149498 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:37.158954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ef94cb7b-b89a-4c5a-a6b6-5f29844a0a2e tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1673 microversion: 2.1 time: 0.269097 Sep 01 14:01:37.173227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 414/820] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:36 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1673 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:38.005052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:38.006296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:38.020028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:38.020588 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:38.021473 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:38.028864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:38.031488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:38.032029 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:38.056224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ce52de-2a26-4f78-8ff8-a8239eaf5939", "name": "network-vif-deleted", "tag": "b00b2c4e-5c8d-4210-be06-e5dd71e0a08f"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:38.073546 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:38.074486 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:38.075322 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:38.076670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:38.117164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] Creating event network-vif-deleted:b00b2c4e-5c8d-4210-be06-e5dd71e0a08f for instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 on hv-cinder-83976 Sep 01 14:01:38.123142 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-94f39f3c-a661-48bb-9fce-7e5ee0556ccf req-bfcf0889-71df-4609-8a2d-9cb13ed4e7bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074323 Sep 01 14:01:38.125015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 415/821] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:38.181182 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:38.182032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:38.195794 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:38.196290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:38.196746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:38.197484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:38.197944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:38.198373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:38.248054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:38.329985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:38.344793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:38.352848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:38.354446 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5a81c0ce-1d64-4a0f-9b8f-3063e6a907f2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.353948 Sep 01 14:01:38.355205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 407/822] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:37 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:38.580450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35ebc3dbc1f4f348f97041627fc68b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d00b24399a40d2b070bfd90e73f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:38.592785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-29703509-7891-40b8-a6e1-202de1432806 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 200 len: 1606 microversion: 2.1 time: 0.416318 Sep 01 14:01:38.593876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 416/823] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:38 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 1606 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:39.388101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:39.392308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:39.402991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:39.403784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:39.404420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:39.406035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:39.406693 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:39.407285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:39.590793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:39.599879 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:39.601361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:39.602569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6c960368-a06f-40ae-a716-368e110fcc42 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.227507 Sep 01 14:01:39.603129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 408/824] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:39 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:39.622760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:39.622760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:39.634253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:39.635036 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:39.635751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:39.636838 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:39.637460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:39.638047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:39.660628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 HTTP/1.1 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:01:39.662811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:39.666172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '97ce52de-2a26-4f78-8ff8-a8239eaf5939'} Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:39.667739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:39.671316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:39.686296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:39.686296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4246c003-b66a-426b-a4b9-97411987429c tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 404 len: 111 microversion: 2.1 time: 0.049897 Sep 01 14:01:39.686296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 417/825] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:39 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:39.690012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1b87cfda-524c-4f61-ab71-d4cbc95deb45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '.version_select at 0x7f980eb095e0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:39.806148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1b87cfda-524c-4f61-ab71-d4cbc95deb45 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567398978" status: 202 len: 0 microversion: 2.1 time: 0.129372 Sep 01 14:01:39.806519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 409/826] 10.222.0.50 () {58 vars in 1221 bytes} [Thu Sep 1 14:01:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567398978 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:01:40.626603 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:40.627238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:40.634756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:40.635240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:40.635701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:40.636531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:40.636978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:40.637402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:40.798056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:40.815566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:40.815566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:40.815566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b2c34c1e-d2af-45c5-9760-e501c2537b6e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.187752 Sep 01 14:01:40.815845 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 418/827] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:40 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:41.834066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:41.834782 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:41.842173 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:41.843563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:41.844083 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:41.844896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:41.845636 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:41.846143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:42.130281 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:42.140811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:42.142380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:42.143727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-faa13ef6-6b20-4d67-b071-31cf51be9b8a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.313621 Sep 01 14:01:42.144424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 410/828] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:41 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:43.183758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:43.185962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:43.193884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:43.194587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:43.195248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:43.200004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:43.200004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:43.200004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:43.412346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:43.423630 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:43.425680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:43.426886 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b1b48bb3-a0c0-4e70-8281-4db553881b6c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.248819 Sep 01 14:01:43.427667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 419/829] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:43 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:44.191102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:44.192873 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:44.204800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.206011 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.207015 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.208309 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.209520 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.210477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.240170 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 HTTP/1.1 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:01:44.243406 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.244789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '97ce52de-2a26-4f78-8ff8-a8239eaf5939'} Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:44.245592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.246881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.254441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:44.254441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2e77382f-20e0-4ecb-ae66-035a9bca54a6 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 404 len: 111 microversion: 2.1 time: 0.062615 Sep 01 14:01:44.254441 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 411/830] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:01:44 2022] DELETE /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:44.263718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:44.264724 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 97ce52de-2a26-4f78-8ff8-a8239eaf5939] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:44.276958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.278248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.279193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.280523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.281208 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.281962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.307610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 HTTP/1.1 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:01:44.310726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.313196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '97ce52de-2a26-4f78-8ff8-a8239eaf5939'} Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:44.314074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. Sep 01 14:01:44.318674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:44.319987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 97ce52de-2a26-4f78-8ff8-a8239eaf5939 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:44.319987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-76e9b753-efa5-4eb9-8a8f-aa9430fc70c9 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939" status: 404 len: 111 microversion: 2.1 time: 0.061085 Sep 01 14:01:44.319987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 420/831] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:44 2022] GET /compute/v2.1/servers/97ce52de-2a26-4f78-8ff8-a8239eaf5939 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:44.456092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:44.458377 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:44.469816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.471816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.472335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.478157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.479077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.479779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.761755 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:44.771075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:44.772799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:44.774336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a78602f6-9c0c-44e7-86ff-4f68f00f753b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.328354 Sep 01 14:01:44.788200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 412/832] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:44 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:45.687459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:45.688614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:45.697126 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.697944 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.698608 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.699449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.701184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.701719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.722206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d HTTP/1.1 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:01:45.725347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.731384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '4925f2c9-4e1b-4fdb-bbc1-bb409727546d'} Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:45.732553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.734377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.736503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:45.736503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e4010b11-2224-4861-9f25-c7febc5d4bcd tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 404 len: 111 microversion: 2.1 time: 0.044135 Sep 01 14:01:45.736503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 421/833] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:01:45 2022] DELETE /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:45.742304 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:45.743565 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] [instance: 4925f2c9-4e1b-4fdb-bbc1-bb409727546d] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:45.752583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.753410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.754065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.754881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.755550 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.756150 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.770754 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] HTTP exception thrown: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Request method failure captured: Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d HTTP/1.1 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELmTDh8rgBDhGmEHhDXEIbBye-4cVbs_qUa4GdxF2osBgwE1SfMxUFMXbi6xXINl7t7Q23DDMY_lCfA_ekcoxoyN7Uh_PFGoz4nMhJo4vRSMk2yMOOnJl-ngFlOETrqZxuX9BSVz9XPSEFBeUocnGw9Y0f8u55LsylTu5UrlE3lhexg Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:01:45.772321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0d00b24399a40d2b070bfd90e73f407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0d00b24399a40d2b070bfd90e73f407"}]}] Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: b0d00b24399a40d2b070bfd90e73f407 Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1653423473 Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: e35ebc3dbc1f4f348f97041627fc68b9 Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeTestJSON-1653423473-project Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.773651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '4925f2c9-4e1b-4fdb-bbc1-bb409727546d'} Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:45.774398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. Sep 01 14:01:45.776080 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:01:45.777487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] Returning 404 to user: Instance 4925f2c9-4e1b-4fdb-bbc1-bb409727546d could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:45.777487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-03ed391b-14a1-44a9-aa6c-7e7dad7447e5 tempest-AttachVolumeTestJSON-1653423473 tempest-AttachVolumeTestJSON-1653423473-project] 10.222.0.50 "GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d" status: 404 len: 111 microversion: 2.1 time: 0.035807 Sep 01 14:01:45.777487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 413/834] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:45 2022] GET /compute/v2.1/servers/4925f2c9-4e1b-4fdb-bbc1-bb409727546d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:45.799765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:45.800600 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:45.807182 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.807701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.808142 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.808842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.809296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.809718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.984179 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:45.993311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:45.994734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:45.995968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-18f80ef7-9db9-473e-aae6-e426f3e37b9e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1740 microversion: 2.20 time: 0.200751 Sep 01 14:01:45.996524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 422/835] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:45 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:46.824189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:46.843939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:46.844845 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:46.850190 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:46.863666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] Creating event network-vif-plugged:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:01:46.869856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-a3548463-22dc-4e08-9664-ada1e8311256 req-5f42d152-8d86-4891-8de5-73ba075d56db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051084 Sep 01 14:01:46.870696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 414/836] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:47.020434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:47.021967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:47.051317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:47.052692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:47.053417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:47.054406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:47.055002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:47.055681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:47.256396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:47.265365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:47.266836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:47.268052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2e5da26b-22ad-47c6-b3fd-e7e7bfe56bab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.254011 Sep 01 14:01:47.268680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 423/837] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:47 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:48.298576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:48.299751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:48.306819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:48.310258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:48.311621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:48.312690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:48.314167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:48.314909 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:48.315545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:48.627576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:48.646221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:48.647720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:48.649176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-764db439-5115-4f9a-a3d9-19eb15f0c43d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.359672 Sep 01 14:01:48.663906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 415/838] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:48 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:49.674227 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:49.674854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:49.691314 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:49.692693 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:49.693369 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:49.694551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:49.699119 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:49.702393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:49.947300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:49.959157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:49.961215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:49.965742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-58e4ad21-f062-4a5f-ba4b-3f1f4f099707 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.293513 Sep 01 14:01:49.965742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 424/839] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:49 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:50.989713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:50.996149 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:50.999782 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:51.001154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:51.001783 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:51.002702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:51.003310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:51.003905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:51.198794 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:51.208429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:51.215115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:51.215115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e811dc02-1044-4aca-ae13-3e16eb83c364 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.228803 Sep 01 14:01:51.215115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 416/840] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:50 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:52.244457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:52.245031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:52.252946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:52.253862 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:52.254474 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:52.255402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:52.256041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:52.256633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:52.504104 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:52.520930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:52.524433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:52.525993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-92c40855-4071-4340-acfe-61ef48cd0dfc tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.285522 Sep 01 14:01:52.526862 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 425/841] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:52 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:53.559408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:53.564947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:53.586232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:53.587809 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:53.588881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:53.590996 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:53.592141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:53.593128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:53.883804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:53.893011 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:53.894609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:53.896021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1752929a-ab13-438a-a481-7247e4771630 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.345229 Sep 01 14:01:53.896981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 417/842] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:53 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:54.923321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:54.924198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:54.941506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:54.942885 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:54.944801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:54.957551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:54.958331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:54.958852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:55.249876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:55.260378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:55.264923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:55.266767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1328040b-ae1d-4e13-b922-cff91f0f2727 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.348972 Sep 01 14:01:55.267869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 426/843] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:54 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:56.290348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:56.291172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:56.299076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.299935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.300596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.301716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.302421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.306372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.519487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:56.530489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:56.535887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:56.539827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-97736146-ddcb-4fc3-94e5-d68c66409334 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.253476 Sep 01 14:01:56.541936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 418/844] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:56 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:57.570655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:57.570655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:57.582483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-520796069", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:57.586831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:57.608749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:57.608749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:57.608749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:57.608749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:57.609327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:57.609327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:57.689276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] validate_networks() for None {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:01:57.797990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:57.807166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:57.808778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:57.810321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-aab24f56-68b4-4e8a-854a-89ab786f5504 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.247459 Sep 01 14:01:57.811306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 427/845] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:57 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:58.082979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:01:58.083433 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:01:58.083908 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:01:58.084313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:01:58.084719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:01:58.097578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:58.098421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:58.099078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:58.099848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:58.100470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:58.100906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:58.119515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Getting quotas for project d5f855115eba40748db48675c0a6e4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:01:58.124185 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Getting quotas for user 7f99cc2b4bc34d67aa65b16ad8b47f1a and project d5f855115eba40748db48675c0a6e4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:01:58.136589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:01:58.139605 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:01:58.299508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1a865ece-f34a-4eda-850e-791124b55772 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727321 Sep 01 14:01:58.308367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 419/846] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:01:58.316425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9ce0f146-70e4-4428-8219-28f7864e4502 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:58.317041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9ce0f146-70e4-4428-8219-28f7864e4502 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:58.419147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9ce0f146-70e4-4428-8219-28f7864e4502 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:58.440832 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9ce0f146-70e4-4428-8219-28f7864e4502 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1214 microversion: 2.1 time: 0.129438 Sep 01 14:01:58.442006 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 428/847] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:58 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:58.848731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:58.849990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:58.860418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:58.861201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:58.861848 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:58.862952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:58.863629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:58.864255 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:59.041558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:59.056161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:59.058093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:59.059908 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-912a1b05-2c62-4b2e-9cdd-0798be24c4d2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.229141 Sep 01 14:01:59.061292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 420/848] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:58 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:59.464462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-35906c61-cd1d-426e-9875-3e7a6edc2620 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:59.465063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-35906c61-cd1d-426e-9875-3e7a6edc2620 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:59.531122 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-35906c61-cd1d-426e-9875-3e7a6edc2620 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:59.540769 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-35906c61-cd1d-426e-9875-3e7a6edc2620 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1214 microversion: 2.1 time: 0.080477 Sep 01 14:01:59.541349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 429/849] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:59 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:00.097497 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:00.101534 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:00.120145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.121856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.122401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.123201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.124307 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.124803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.313883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:00.330838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:00.332527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:00.337630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-52b73d2a-7807-4e8f-9eeb-3d1c849b09c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.240237 Sep 01 14:02:00.337630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 421/850] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:00 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:00.562170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:00.562796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:00.572727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.576787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.576787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.578662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.580558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.581237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.717684 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:00.730670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6459a2a3-c842-4f7e-b0ff-2375266904e8 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1210 microversion: 2.1 time: 0.172005 Sep 01 14:02:00.731687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 430/851] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:00 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:01.359279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:01.359923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:01.367120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:01.367674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:01.368102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:01.368811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:01.369253 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:01.369757 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:01.539646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:01.556054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:01.558976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:01.561177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-29af9261-fdaa-4a9b-adce-f644bc4528d1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1735 microversion: 2.20 time: 0.206350 Sep 01 14:02:01.562139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 422/852] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:01 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:01.765335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:01.765977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:01.772299 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:01.772780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:01.773910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:01.774016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:01.774409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:01.774852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:01.839599 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:01.849491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4edd9803-da82-4417-98e1-e9219c67874c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1274 microversion: 2.1 time: 0.088677 Sep 01 14:02:01.850074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 431/853] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:01 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:02.589622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:02.590222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:02.598409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:02.598971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:02.599439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:02.604357 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:02.604357 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:02.604357 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:02.847098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:02.871240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:02.875910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:02.877527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7d720cfe-56c8-485e-b906-4e8f4d061fa5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1717 microversion: 2.20 time: 0.291892 Sep 01 14:02:02.878538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 423/854] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:02 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1717 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:02.882480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:02.884784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:02.896586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:02.897475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:02.898245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:02.899763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:02.900582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:02.901316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:02.997393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:03.010163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a2df308b-2270-4ad0-adb5-6e439221afa7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1272 microversion: 2.1 time: 0.142304 Sep 01 14:02:03.011024 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 432/855] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:02 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:03.907545 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:03.908163 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:03.914720 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:03.915193 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:03.915652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:03.916347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:03.916804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:03.917198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:04.039555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:04.040829 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:04.047097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:04.047606 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:04.048043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:04.048810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:04.049446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:04.049859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:04.058857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:04.067726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:04.069168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:04.070372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-90fc1118-196d-4273-beba-25fbf9ad64c0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1717 microversion: 2.20 time: 0.167318 Sep 01 14:02:04.070946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 424/856] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:03 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:04.250149 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:04.258866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-24d92f58-f483-4152-b6db-5ec4294450bc tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.223437 Sep 01 14:02:04.259454 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 433/857] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:04 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:05.097125 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:05.097805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:05.105400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:05.106028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:05.106558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:05.107421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:05.108500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:05.109708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:05.275538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:05.285347 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:05.286733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:05.289147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:05.291827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:05.293823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-f0c87dca-649a-476d-bfcf-1f2a1745ffb4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1717 microversion: 2.20 time: 0.203030 Sep 01 14:02:05.295801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 425/858] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:05 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:05.297313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:05.297998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:05.298621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:05.299604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:05.300437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:05.301184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:05.456566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:05.466486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f18922c4-efe6-4af4-a57d-634217fd82ea tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.188832 Sep 01 14:02:05.480953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 434/859] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:05 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:05.684551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b3174b-67aa-4902-b7f8-3b5dc2900818", "tag": "b54b5750-3055-4e1a-80c2-7c51a5620c50"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:05.697642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:05.697642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:05.697642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:05.709586 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] Creating event network-changed:b54b5750-3055-4e1a-80c2-7c51a5620c50 for instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 on hv-cinder-83976 Sep 01 14:02:05.716179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-dae56b51-ee44-481f-8eb3-b50cf21cc7e4 req-69d975c7-6106-47be-b740-bbb7dfda8e07 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035664 Sep 01 14:02:05.717917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 426/860] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:06.326466 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:06.328158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:06.341255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.342102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.342888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.344046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.344957 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.345614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.490448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:06.490967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:06.504369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.505331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.505685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:06.506864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.507882 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.508564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.509522 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.515314 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:06.517452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:06.518840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6754a812-702c-41f2-a571-e67dd5f5a9ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1660 microversion: 2.20 time: 0.203345 Sep 01 14:02:06.519946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 435/861] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:06 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1660 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:06.545906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8130ae7-c2af-40fd-8909-4e0163855c1f"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:06.548926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:06.555334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.555851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.556567 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.557270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.557970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.564064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.675384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:06.682820 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:06.690998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-611fedf5-c06a-4f33-8fca-ba586e1a78a1 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.205957 Sep 01 14:02:06.691622 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 427/862] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:06 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:06.841679 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "name": "network-vif-unplugged", "status": "completed", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:06.862836 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:06.863320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:06.863795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:06.867999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=100 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:06.876201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.compute.server_external_events [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] Unable to find a host for instance 89a059e6-9ac3-4140-a725-5092e3a4a936. Dropping event network-vif-unplugged {{(pid=127708) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 14:02:06.877110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-e0000352-d7d1-4e28-a5ac-a1821b35bec2 req-728aa18a-1f7e-4ed1-8b97-234fec81b391 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041072 Sep 01 14:02:06.877721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 428/863] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 14:02:07.711894 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:07.712560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:07.719587 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:07.720074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:07.720500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:07.721195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:07.721637 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:07.722052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:07.865867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:07.874312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3bd0d236-8428-4b5a-98a2-50cf4552cb39 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.166375 Sep 01 14:02:07.874895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 429/864] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:07 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:07.969329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fc46768c-8e25-4ba4-aed9-94a9af041eab tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.429539 Sep 01 14:02:07.970431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 436/865] 10.222.0.50 () {62 vars in 1364 bytes} [Thu Sep 1 14:02:06 2022] POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments => generated 188 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:02:08.118348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:08.118837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:08.120700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:08.125591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.131246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.131246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:08.131246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.131246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.131771 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:08.132981 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:08.774935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5936b1a8-6bc2-470d-984b-e9926966ecfd tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments/f8130ae7-c2af-40fd-8909-4e0163855c1f" status: 202 len: 0 microversion: 2.20 time: 0.660315 Sep 01 14:02:08.775772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 430/866] 10.222.0.50 () {60 vars in 1457 bytes} [Thu Sep 1 14:02:08 2022] DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments/f8130ae7-c2af-40fd-8909-4e0163855c1f => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:02:08.840038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:08.840680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:08.849386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.849888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.850326 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:08.851343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.851850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.852313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:08.892623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127709) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:02:08.899314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:08.900472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:08.914778 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.915657 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.916715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:08.917893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:08.918421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:08.918934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:09.088656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:09.097481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1d1b8596-a750-4c52-b927-6fc58cfdb089 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.205917 Sep 01 14:02:09.098060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 431/867] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:08 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:09.219437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6c3abbdd-241c-4db3-8ecf-c2b392eb59ac tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/action" status: 202 len: 0 microversion: 2.20 time: 0.383659 Sep 01 14:02:09.220341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 437/868] 10.222.0.50 () {62 vars in 1319 bytes} [Thu Sep 1 14:02:08 2022] POST /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:02:09.229164 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:09.229957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:09.236855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:09.237343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:09.237834 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:09.238490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:09.238935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:09.239349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:09.385245 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:09.396797 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:09.399942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:09.402142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fa63c689-cc98-467a-b690-3d7e7d06537f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1668 microversion: 2.20 time: 0.176795 Sep 01 14:02:09.403100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 432/869] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:09 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:10.115094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:10.120163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:10.120791 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:10.127423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:10.128002 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:10.129406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:10.129406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:10.129860 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:10.130245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:10.298152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:10.306025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3b014912-387d-4246-ba0c-7e3baebf0964 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.191628 Sep 01 14:02:10.306601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 438/870] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:10 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:10.440182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:10.441000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:10.447970 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:10.448469 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:10.452174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:10.452174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:10.452174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:10.452174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:10.622411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:10.632410 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:10.634027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:10.635246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0c147e1c-128b-4f24-8a53-8508cd23b4c4 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1668 microversion: 2.20 time: 0.199513 Sep 01 14:02:10.635928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 433/871] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:10 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1668 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:11.328730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:11.329401 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:11.336686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:11.337178 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:11.337638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:11.338373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:11.338822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:11.339247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:11.507175 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:11.519852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-38955410-1724-450a-9e68-6d3798ab3656 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.195042 Sep 01 14:02:11.520677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 439/872] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:11 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:11.662972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:11.663881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:11.672854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:11.673443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:11.673928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:11.674709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:11.675212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:11.675733 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:11.842654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:11.856427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:11.859711 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:11.860906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d7dba12b-b600-43a5-9172-f91652dbf410 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.202785 Sep 01 14:02:11.861768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 434/873] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:11 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:12.544636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:12.546111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:12.554295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:12.554966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:12.555578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:12.556643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:12.557215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:12.557851 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:12.731514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:12.740805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-011e3d09-5886-4f2c-a9c5-c97f7482cab0 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.201537 Sep 01 14:02:12.741399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 440/874] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:12 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:12.906122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:12.906870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:12.913788 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:12.914276 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:12.914702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:12.915456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:12.915993 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:12.916614 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:13.091634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b3174b-67aa-4902-b7f8-3b5dc2900818", "name": "network-vif-plugged", "status": "completed", "tag": "b54b5750-3055-4e1a-80c2-7c51a5620c50"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:13.102282 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:13.109264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:13.110291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:13.111144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:13.117246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:13.119569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:13.121565 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fa0df7a8-99c1-484b-ad4b-b98a22dd2e4e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.219996 Sep 01 14:02:13.122505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 435/875] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:12 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:13.128812 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] Creating event network-vif-plugged:b54b5750-3055-4e1a-80c2-7c51a5620c50 for instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 on hv-cinder-83976 Sep 01 14:02:13.134588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-11fba770-8157-482f-8f8d-9308fdfb8236 req-bbea8dc9-e50b-4b74-ad46-d555663a65d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054791 Sep 01 14:02:13.135231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 441/876] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:13.767515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:13.768549 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:13.775670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:13.776162 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:13.776596 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:13.777312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:13.777763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:13.778187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:13.990363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:14.009538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-afd55c38-498d-4c15-a38a-1f763b4cf49e tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.247899 Sep 01 14:02:14.010907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 436/877] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:13 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:14.150072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:14.154622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:14.173344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:14.174112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:14.175152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:14.176604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:14.177622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:14.178548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:14.383821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:14.394456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:14.396312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:14.398238 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a4e1bfbf-b58d-4f7c-aa33-6f1c9f01bf46 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.255719 Sep 01 14:02:14.398876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 442/878] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:14 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:15.049440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:15.050675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:15.061758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:15.062944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:15.064317 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:15.066133 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:15.067579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:15.068912 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:15.256982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:15.266472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1d7654dc-c2d8-49b7-8398-62ab77afe144 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.223835 Sep 01 14:02:15.267234 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 437/879] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:15 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:15.428007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:15.428986 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:15.438743 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:15.439763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:15.441070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:15.442833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:15.444032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:15.444715 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:15.702650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:15.721826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:15.721826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:15.721826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2e1d30d1-3ea8-4f1b-a75a-5b28787c6cd1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.302051 Sep 01 14:02:15.722315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 443/880] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:15 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:16.291739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:16.292858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:16.302023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:16.302880 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:16.303616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:16.304716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:16.305520 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:16.306646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:16.549252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:16.583250 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0efeff83-1766-410c-857c-3f14b15efa90 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.297050 Sep 01 14:02:16.588218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 438/881] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:16 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:16.748947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:16.749529 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:16.762392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:16.763442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:16.764244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:16.765692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:16.766546 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:16.767335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:16.989632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:17.002263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:17.004402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:17.005919 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6ded1d97-4a03-4b1b-890d-e716e21955c8 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.262829 Sep 01 14:02:17.006693 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 444/882] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:16 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:17.610697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:17.611428 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:17.618611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:17.619101 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:17.619584 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:17.620310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:17.620765 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:17.621189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:17.807335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:17.816543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ad2b5656-9568-405d-9beb-17f6135bde01 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.210184 Sep 01 14:02:17.819627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 439/883] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:17 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:18.045492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:18.046338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:18.053642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:18.058459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:18.058924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:18.059893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:18.060872 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:18.061501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:18.307531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:18.323095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:18.325941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:18.330405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4541022a-b38d-4eb4-9cc5-40c45deeef12 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.286339 Sep 01 14:02:18.330405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 445/884] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:18 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:18.839425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:18.840776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:18.848435 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:18.850821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:18.851328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:18.851847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:18.852551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:18.853225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:18.853646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:19.054747 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:19.067054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-09ef4eb4-ab35-4249-8269-e89592af3a96 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.231284 Sep 01 14:02:19.069630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 440/885] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:18 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:19.356665 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:19.359722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:19.369438 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:19.376584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:19.376584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:19.376584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:19.376584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:19.377242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:19.599984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:19.609853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:19.612433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:19.614073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-aa969326-2d59-44f3-950c-b97e08f6317c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.263887 Sep 01 14:02:19.627098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 446/886] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:19 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:20.095998 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:20.096850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:20.104494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:20.104977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:20.105621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:20.106382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:20.106841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:20.107334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:20.458702 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:20.478750 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-65df9e41-df6c-4da1-bef4-8cb10008f20b tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.386546 Sep 01 14:02:20.479651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 441/887] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:20 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:20.644459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:20.646642 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:20.668949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:20.672371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:20.672930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:20.674571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:20.675621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:20.676247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:20.908611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:20.926637 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:20.930615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:20.933664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e65e0267-83ba-4cef-8718-2c9d6ca9a414 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.292933 Sep 01 14:02:20.935186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 447/888] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:20 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:21.583000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:21.583000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:21.583000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.583000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.584407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:21.584407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.584407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.584407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:21.686898 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:21.694857 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-de301c4b-5434-4f6c-8bd9-3c18553b0ea6 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1314 microversion: 2.1 time: 0.185784 Sep 01 14:02:21.695471 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 442/889] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:21 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:21.960245 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:21.962362 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:21.969907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.971803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.971803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:21.972307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.973039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.973522 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:22.194614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:22.214052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:22.217253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:22.219879 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-95d8f2a8-aa7d-48fa-a8a1-8840d4be0861 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.264069 Sep 01 14:02:22.235396 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 448/890] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:21 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:22.723031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:22.723031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:22.734933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:22.735817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:22.736385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:22.737204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:22.737777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:22.742609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:22.771300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:22.923058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:22.931631 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c21c1664-fd78-414c-ad4c-bcf6201d553c tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1464 microversion: 2.1 time: 0.217155 Sep 01 14:02:22.936249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 443/891] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:22 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1464 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:22.991947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:22.992494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:23.000383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.000981 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.001482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.002262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.002782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.003325 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.030797 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:02:23.067806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:23.248468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:23.249422 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:23.261061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.261918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.262696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.264008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.264827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.265602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.381259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-607066fa-a1bb-4e00-9a0b-4ac7b64b7271 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "DELETE /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 204 len: 0 microversion: 2.1 time: 0.393000 Sep 01 14:02:23.381852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 449/892] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:02:22 2022] DELETE /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:02:23.391498 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:23.392208 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:23.398616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.399101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.399871 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.400607 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.401058 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.401476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.450071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:23.463811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:23.465653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:23.468288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3f42dcbe-525b-40ac-9fb8-caf023f550ff tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.227574 Sep 01 14:02:23.469249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 444/893] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:23 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:23.567602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:23.581835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-10901ba3-9c3e-4e52-bbb4-b40d39ad07a3 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1470 microversion: 2.1 time: 0.194851 Sep 01 14:02:23.582919 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 450/894] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:23 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:24.492979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:24.493579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:24.501640 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:24.501957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:24.502381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.503081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:24.503562 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:24.503985 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.609945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:24.611321 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:24.625517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:24.626801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:24.627616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.628945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:24.630095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:24.630875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.713931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:24.724141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:24.725674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:24.726883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3f02a888-aca1-4d5f-acdc-b0c0a843e4d5 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.238072 Sep 01 14:02:24.727512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 445/895] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:24 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:24.817353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:24.826470 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8ac8af74-f606-4530-8f92-092e8c055a52 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1470 microversion: 2.1 time: 0.224676 Sep 01 14:02:24.827049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 451/896] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:24 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:25.762973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:25.765789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:25.781613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.782932 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.784095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.785512 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.786579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.787865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.848842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:25.850315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:25.859761 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.860571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.861485 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.862585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.863117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.863813 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:26.114444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:26.127660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cad0b81c-c817-432a-83ba-333e7ebf5331 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1470 microversion: 2.1 time: 0.282619 Sep 01 14:02:26.142784 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:26.143974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 452/897] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:25 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:26.159961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:26.163983 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:26.166864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9e0bef08-c87e-4b7c-88f5-69ec6570975b tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.410563 Sep 01 14:02:26.177917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 446/898] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:25 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:26.554659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b3174b-67aa-4902-b7f8-3b5dc2900818", "name": "network-vif-deleted", "tag": "b54b5750-3055-4e1a-80c2-7c51a5620c50"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:26.565651 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:26.566248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:26.566754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:26.582260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] Creating event network-vif-deleted:b54b5750-3055-4e1a-80c2-7c51a5620c50 for instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 on hv-cinder-83976 Sep 01 14:02:26.589596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-08f04728-c3ec-4e53-80ab-bb0f2288d24d req-b9253aa0-aa6b-4986-9f34-9a36c0d7afa1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038358 Sep 01 14:02:26.591781 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 453/899] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:27.151476 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:27.152231 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:27.160744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.161393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.162299 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.163452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.163906 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.164694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.206301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:27.207069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:27.213580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.214071 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.214500 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.215203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.215679 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.216112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.243896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:27.252516 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eb7236e9-e250-4443-854e-d14cadfdc1f7 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1428 microversion: 2.1 time: 0.105844 Sep 01 14:02:27.253103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 447/900] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:27 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:27.363181 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:27.371547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:27.373196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:27.374511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-13de4932-d9eb-4114-9589-77953e4ffec2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.173477 Sep 01 14:02:27.375084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 454/901] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:27 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:28.274436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:28.275042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:28.282175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.282653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.283092 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.283841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.284315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.284772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.319420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.319899 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.320336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.320767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lazy-loading 'fault' on Instance uuid 03b3174b-67aa-4902-b7f8-3b5dc2900818 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:02:28.362813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f99cc2b4bc34d67aa65b16ad8b47f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f855115eba40748db48675c0a6e4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:28.371014 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ca0892e6-26f5-41f1-bbd0-0ff596effb65 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 200 len: 1304 microversion: 2.1 time: 0.100378 Sep 01 14:02:28.374779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 448/902] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:28 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:28.397972 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:28.406202 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:28.408908 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:28.414131 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.414828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.415421 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.416261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.416783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.417275 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.569516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:28.579331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:28.580801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:28.581925 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0cc15486-83d8-4f9c-9370-9b4eac2f45e1 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.187872 Sep 01 14:02:28.582497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 455/903] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:28 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:28.993106 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:29.004681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:29.005228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:29.005854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.188716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] Creating event network-vif-plugged:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:02:29.194379 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-0a4b2172-3fc8-4a68-9917-6d289d01e29a req-8e4a3102-f1b2-4009-a568-f37d2567a234 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205027 Sep 01 14:02:29.195943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 449/904] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:29.397512 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:29.398384 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] [instance: 03b3174b-67aa-4902-b7f8-3b5dc2900818] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:29.407150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:29.407927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:29.408536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.409561 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:29.410341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:29.411118 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.430240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] HTTP exception thrown: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Request method failure captured: Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 HTTP/1.1 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELtS5FarQqwTDKsqu8vudvbE0jgEH7WncNczXsdTRCaRiwExbqzG7uzecoRIFE5Md1dkAfSI_UCcDX_GDoETDEgIEGGqLRAl1Y22rHR_6vKnYMnR3gftIAKKUhwq-BStMzUgmkCT4Yzj2qqKHtzCH5LTSqxMPBVyM0UTh4no5ZX8zEE Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: d5f855115eba40748db48675c0a6e4f1 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-VolumesNegativeTest-1720312537 Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:02:29.432290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5f855115eba40748db48675c0a6e4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5f855115eba40748db48675c0a6e4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5f855115eba40748db48675c0a6e4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5f855115eba40748db48675c0a6e4f1"}]}] Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-VolumesNegativeTest-1720312537 Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: d5f855115eba40748db48675c0a6e4f1 Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-VolumesNegativeTest-1720312537 Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-VolumesNegativeTest-1720312537-project Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 7f99cc2b4bc34d67aa65b16ad8b47f1a Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-VolumesNegativeTest-1720312537-project Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. Sep 01 14:02:29.434054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '03b3174b-67aa-4902-b7f8-3b5dc2900818'} Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:02:29.435721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. Sep 01 14:02:29.437350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:02:29.440116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] Returning 404 to user: Instance 03b3174b-67aa-4902-b7f8-3b5dc2900818 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:02:29.443454 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-028394dd-0fc5-4f83-8177-8298f17b8a60 tempest-VolumesNegativeTest-1720312537 tempest-VolumesNegativeTest-1720312537-project] 10.222.0.50 "GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818" status: 404 len: 111 microversion: 2.1 time: 0.053115 Sep 01 14:02:29.449605 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 456/905] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:29 2022] GET /compute/v2.1/servers/03b3174b-67aa-4902-b7f8-3b5dc2900818 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:02:29.607479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:29.608247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:29.615488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:29.616136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:29.616579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.617354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:29.617932 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:29.618319 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.849443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:29.862333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:29.864313 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:29.865830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-525083f6-794a-454e-a991-4dcd2d7e035d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.263865 Sep 01 14:02:29.866710 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 450/906] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:29 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:30.892419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:30.896276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:30.918376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.926145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.926145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:30.926145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.926145 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.927211 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.138073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:31.138073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:31.138539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:31.138539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0ec6c3e7-557e-402f-b872-d2c71b9b1ef0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.248030 Sep 01 14:02:31.138539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 457/907] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:30 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:32.157384 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:32.157986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:32.164371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:32.164837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:32.165268 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:32.165953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:32.166394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:32.166808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:32.371346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:32.378120 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:32.379653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:32.380838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ae68b243-eec7-4ca0-8a20-7fb2d85a132e tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1726 microversion: 2.20 time: 0.227395 Sep 01 14:02:32.381598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 451/908] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:32 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:33.425955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:33.427012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:33.443528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:33.443934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:33.444581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:33.445305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:33.445853 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:33.446580 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:33.598450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:33.615256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:33.618203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:33.620331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fbc3d1e1-5103-41b7-8ee8-c12311fa914c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1713 microversion: 2.20 time: 0.203967 Sep 01 14:02:33.621388 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 458/909] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:33 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1713 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:06.426935 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:06.429816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:06.432419 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=25 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:06.433565 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=51 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:06.439706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.440196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.440727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.441483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.441937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.442359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.480768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-36229bfa-4e75-4e18-846a-9e443c1ac1e0 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057957 Sep 01 14:03:06.482074 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 452/910] 10.222.0.50 () {60 vars in 1343 bytes} [Thu Sep 1 14:03:06 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:06.549987 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:06.550640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:06.552804 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=7 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:06.553492 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:06.554281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:03:06.554441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Thu Sep 1 14:03:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 (ip 10.222.0.50) !!! Sep 01 14:03:06.561296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.561786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.562221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.562943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.563491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.570631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.597050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:03:07.070909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1cd8b1e1-218e-427b-bd29-8e39f31e844d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 204 len: 0 microversion: 2.20 time: 0.524396 Sep 01 14:03:07.071510 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 459/911] 10.222.0.50 () {60 vars in 1280 bytes} [Thu Sep 1 14:03:06 2022] DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 14:03:07.080823 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:07.086450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:07.092863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.093745 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.094514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.095791 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.096590 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.097340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.261257 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.270798 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.273952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.273952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d2804b1a-cf73-4ec3-a178-cab748ddc66d tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.197166 Sep 01 14:03:07.274266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 453/912] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:07 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:08.299140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:08.299875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:08.307111 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.307638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.308076 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.308787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.309233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.309653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.514942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:08.525618 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:08.527087 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:08.528515 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-14626462-0fcd-4ff1-9e57-ca389fdfde1f tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1719 microversion: 2.20 time: 0.233876 Sep 01 14:03:08.529100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 460/913] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:08 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:09.558402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:09.560349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:09.573099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.574118 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.575581 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.577159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.578122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.578917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.687219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.715789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.715789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.715789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5980bdf3-f00b-40c6-a859-29e3a31c0d82 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1652 microversion: 2.20 time: 0.163058 Sep 01 14:03:09.717261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 454/914] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:09 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1652 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:10.013539 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a059e6-9ac3-4140-a725-5092e3a4a936", "name": "network-vif-deleted", "tag": "cf2ee5f9-c5ae-43fa-b71f-9811f8d58738"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:10.028514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.029320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.029933 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.043807 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] Creating event network-vif-deleted:cf2ee5f9-c5ae-43fa-b71f-9811f8d58738 for instance 89a059e6-9ac3-4140-a725-5092e3a4a936 on hv-cinder-83976 Sep 01 14:03:10.049748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-d0599582-57b3-4b93-951d-f68b2876b6cc req-5ab3dd85-1970-4fbe-9f38-8a8c5106917d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Sep 01 14:03:10.050447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 461/915] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:10.742817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:10.744696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:10.754052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.756558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.756558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.756558 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.757016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.757684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.810480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.811420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.812289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.813127 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lazy-loading 'fault' on Instance uuid 89a059e6-9ac3-4140-a725-5092e3a4a936 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:03:10.881862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.895723 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.899336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '658108c26fb74eba911e249819f8b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ccb0fe770a41e99a822a6d4f88d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.901597 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e87025fe-dd52-45b6-9003-fff8bcf1c710 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 200 len: 1369 microversion: 2.20 time: 0.163934 Sep 01 14:03:10.902747 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 455/916] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:10 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:11.929047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:11.929855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:11.937810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.938305 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.938748 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.939513 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.939979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.940415 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.956787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 HTTP/1.1 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:03:11.958477 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:11.961234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '89a059e6-9ac3-4140-a725-5092e3a4a936'} Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:11.963056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:11.966612 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:11.969128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:11.969128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5d0b5733-ca13-4295-aba4-02b27c0ba126 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 404 len: 111 microversion: 2.20 time: 0.035748 Sep 01 14:03:11.969128 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 462/917] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:11 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 14:03:11.973566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-099c3ca6-519d-4852-bbe5-cde47f5423b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '.version_select at 0x7f980ec415e0>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:12.079049 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-099c3ca6-519d-4852-bbe5-cde47f5423b2 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78470436" status: 204 len: 0 microversion: 2.20 time: 0.110317 Sep 01 14:03:12.079704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 456/918] 10.222.0.50 () {60 vars in 1256 bytes} [Thu Sep 1 14:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78470436 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:03:14.457464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:14.458307 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:14.470650 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.471547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.472371 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.473653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.474526 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.475344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.504097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 HTTP/1.1 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:03:14.507383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.510139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '89a059e6-9ac3-4140-a725-5092e3a4a936'} Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:14.511404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.514172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.516960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:14.516960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-446fba37-1ef7-4115-826c-6aa05411b62c tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 404 len: 111 microversion: 2.20 time: 0.059156 Sep 01 14:03:14.516960 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 463/919] 10.222.0.50 () {60 vars in 1280 bytes} [Thu Sep 1 14:03:14 2022] DELETE /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:03:14.520957 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:14.521553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: 89a059e6-9ac3-4140-a725-5092e3a4a936] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:14.532577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.532577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.532577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.532577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.535261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.535261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.549311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 HTTP/1.1 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:03:14.551263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.553867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '89a059e6-9ac3-4140-a725-5092e3a4a936'} Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:14.555393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. Sep 01 14:03:14.557863 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:14.560492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance 89a059e6-9ac3-4140-a725-5092e3a4a936 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:14.560492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cd1ace2b-6cf2-4e56-b2e0-291f7444059a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936" status: 404 len: 111 microversion: 2.20 time: 0.035791 Sep 01 14:03:14.560492 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 457/920] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:14 2022] GET /compute/v2.1/servers/89a059e6-9ac3-4140-a725-5092e3a4a936 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:03:16.036698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.037270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.044437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.050370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.050370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.050370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.050370 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.050946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.063231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 HTTP/1.1 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:03:16.064956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.068033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'b96f4b0f-c912-498b-a106-05ad58398708'} Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:16.069706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.072463 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.075309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:16.075309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-15978146-426d-4b7f-97c0-640e7316fb6a tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 404 len: 111 microversion: 2.20 time: 0.035725 Sep 01 14:03:16.075309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 464/921] 10.222.0.50 () {60 vars in 1280 bytes} [Thu Sep 1 14:03:16 2022] DELETE /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:03:16.077202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.077950 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] [instance: b96f4b0f-c912-498b-a106-05ad58398708] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.085085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.085573 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.086468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.087176 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.087661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.088087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.103230 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] HTTP exception thrown: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Request method failure captured: Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 HTTP/1.1 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELn-pmbKVKPhyIo908P_OYUWIlOqkvFTVonDt0hA7MnA_3JrTiLXEicLQCd6w94kx0DvTghnDuvHSJz9WJsMOBI00nPx8kIC35WNd9C8eHAPEnpHMJG-v626kjNJg-p9F0BikBtYXLVeq6AzXBkFZQL9Zq6LpEKj0wLD2BTs3p_y-dM Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:03:16.104941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5ccb0fe770a41e99a822a6d4f88d401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5ccb0fe770a41e99a822a6d4f88d401"}]}] Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: a5ccb0fe770a41e99a822a6d4f88d401 Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224376399 Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 658108c26fb74eba911e249819f8b290 Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224376399-project Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.108707 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'b96f4b0f-c912-498b-a106-05ad58398708'} Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:16.110361 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. Sep 01 14:03:16.113423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:03:16.116740 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] Returning 404 to user: Instance b96f4b0f-c912-498b-a106-05ad58398708 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:16.116740 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b203931e-fa84-4f7e-93ea-0382729165b6 tempest-AttachVolumeShelveTestJSON-224376399 tempest-AttachVolumeShelveTestJSON-224376399-project] 10.222.0.50 "GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708" status: 404 len: 111 microversion: 2.20 time: 0.033760 Sep 01 14:03:16.116740 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 458/922] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:16 2022] GET /compute/v2.1/servers/b96f4b0f-c912-498b-a106-05ad58398708 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:03:31.169012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:31.169848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:31.338155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d6e5e79a-eb8b-4265-b170-1e0e2a1c8553 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: .version_select at 0x7f980f08aaf0>, body: {"keypair": {"name": "tempest-keypair-1437429806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWo++8ft4uyLEwTTfvOYhXdYg07eU6KTzeSlAzUzF9zjLAceyFP10OEylpaMJ6nKcuCPnyxZ2kzM4BbUGyb7px6ueylp/SUJEyTygWB/27bzQtI9O/S+u+3QlPCWi4zlQ=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:31.356406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-d6e5e79a-eb8b-4265-b170-1e0e2a1c8553 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:31.362097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-d6e5e79a-eb8b-4265-b170-1e0e2a1c8553 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:31.495341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d6e5e79a-eb8b-4265-b170-1e0e2a1c8553 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.332209 Sep 01 14:03:31.496484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 465/923] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:03:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:35.303725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2096149490", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1e67750-0db8-4b1a-a617-db488366bcfd"}], "security_groups": [{"name": "tempest-securitygroup--1866832541"}], "key_name": "tempest-keypair-1437429806", "user_data": "}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:35.318325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:35.319496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=30 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:35.461323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] validate_networks() for [('d1e67750-0db8-4b1a-a617-db488366bcfd', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:03:36.274314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:03:36.275280 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:03:36.276341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:03:36.277499 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:03:36.278529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:03:36.298194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.299202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.299870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.301447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.302159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.303045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.340293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:36.346067 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:36.363087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:03:36.366114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:03:36.526890 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ea0f4ee4-437a-4420-9773-7a6e704fdc00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.227285 Sep 01 14:03:36.528662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 459/924] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:03:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:03:36.548691 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-21c2c4a1-316e-4d61-94cc-ed8adce47401 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:36.549666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-21c2c4a1-316e-4d61-94cc-ed8adce47401 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:36.697335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-21c2c4a1-316e-4d61-94cc-ed8adce47401 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:36.710059 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-21c2c4a1-316e-4d61-94cc-ed8adce47401 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1242 microversion: 2.1 time: 0.169866 Sep 01 14:03:36.718909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 466/925] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:36 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:37.752186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d775ad98-b02e-49ea-a102-c30249f482bc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:37.753284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d775ad98-b02e-49ea-a102-c30249f482bc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:37.855202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d775ad98-b02e-49ea-a102-c30249f482bc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.869368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d775ad98-b02e-49ea-a102-c30249f482bc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1242 microversion: 2.1 time: 0.125109 Sep 01 14:03:37.869368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 460/926] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:37 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:38.888386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:38.889171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:38.897028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.897549 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.898199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.899139 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.899805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.900410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.996304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:39.015082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2d75ab62-a159-4f2e-ba2b-1198d7ba27c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1246 microversion: 2.1 time: 0.125501 Sep 01 14:03:39.015082 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 467/927] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:38 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:40.057154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:40.060060 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:40.071008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.071735 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.072445 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.074069 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.074861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.075595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.169637 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.187112 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eee803b2-335d-4e7e-bb25-bf3e7b37f230 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1302 microversion: 2.1 time: 0.139557 Sep 01 14:03:40.187763 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 461/928] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:40 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:41.209751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:41.214700 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:41.218530 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.219029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.219507 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.220236 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.220856 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.221107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.515014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.525399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e58e7c02-f264-4cdf-a3c3-3b1a69c64121 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.319922 Sep 01 14:03:41.527543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 468/929] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:41 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:42.555986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:42.557733 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:42.578820 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.580404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.582421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.583480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.586630 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.587944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.656355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d40ff85-321a-4ac4-90ec-bd8f003d6f6e", "tag": "f4d7227f-8d08-46e0-a285-a83e8102516b"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:42.690889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.693652 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.695841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.719718 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] Creating event network-changed:f4d7227f-8d08-46e0-a285-a83e8102516b for instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e on hv-cinder-83976 Sep 01 14:03:42.728398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-ce3bb556-b442-4e18-a639-f97324a2580b req-af83786a-3218-40a3-a2a2-2bf17e61d3d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075437 Sep 01 14:03:42.728398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 469/930] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:42.868495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:42.881561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0560424e-876c-48cd-9584-4fc77e76b185 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.331681 Sep 01 14:03:42.882787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 462/931] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:42 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:43.926462 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:43.930203 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:43.946891 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.950392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.950392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:43.950392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.951721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.952692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.166194 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:44.194152 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-409a2b6d-c631-4b9e-8b06-0d119a1b4cff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.287220 Sep 01 14:03:44.196335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 470/932] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:43 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:45.232721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:45.233543 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:45.242673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.243261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.243891 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.244692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.247099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.247099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.433804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.442765 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5695547b-fb93-4242-bfb3-5e721de8ba4a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.214617 Sep 01 14:03:45.443347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 463/933] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:45 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:46.465154 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.466352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:46.473698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.474198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.474638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.494029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.494029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.494029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.660025 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:46.670052 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-14c19905-3d51-4c22-8a87-8f8df24fcd51 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.208722 Sep 01 14:03:46.671721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 471/934] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:47.693263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:47.693899 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:47.696577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:47.703272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.703527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.709633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.709633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.709633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.709633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.852629 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.861443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-41ba6939-a26b-4b23-a5c8-511f3fe70ede tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.172641 Sep 01 14:03:47.864155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 464/935] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:47 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:48.884619 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:48.885161 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:48.891173 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:48.893516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.894398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.895000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.895932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.896550 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.897140 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.119300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:49.143785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b64ce74c-af05-4f43-bf0d-0abe05c48bad tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.260206 Sep 01 14:03:49.143785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 472/936] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:48 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:49.568338 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d40ff85-321a-4ac4-90ec-bd8f003d6f6e", "name": "network-vif-plugged", "status": "completed", "tag": "f4d7227f-8d08-46e0-a285-a83e8102516b"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:49.594687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=8 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:49.598878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:49.599511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:49.599958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.613824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] Creating event network-vif-plugged:f4d7227f-8d08-46e0-a285-a83e8102516b for instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e on hv-cinder-83976 Sep 01 14:03:49.619597 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-fd6b48b1-6a85-4827-8fd7-25704c8a2995 req-1b92718e-7608-4bb7-b93e-eb6e430c235c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055619 Sep 01 14:03:49.630171 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 465/937] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:50.174196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:50.176194 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:50.200954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.202330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.204502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.205942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.206888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.207408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.476242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:50.488912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a98ba0d7-1ac4-4cc4-a912-7bf3416f1462 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.320802 Sep 01 14:03:50.489513 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 473/938] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:50 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:51.516496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:51.518518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:51.540718 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.541929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.542666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.543931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.544806 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.545494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.801128 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.811598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-325a71d6-7e01-4c22-9f22-f42859001f4b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1368 microversion: 2.1 time: 0.304160 Sep 01 14:03:51.824103 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 466/939] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:51 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:52.834865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:52.836604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:52.844626 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.845475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.846587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.847796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.848509 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.850596 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.059594 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.068578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bea932f7-f42c-4fe2-b686-b06703df9ec8 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1558 microversion: 2.1 time: 0.238109 Sep 01 14:03:53.083386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 474/940] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:52 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:53.091574 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:53.092098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:53.099177 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.099701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.100289 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.101001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.101865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.101865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.191953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e87b4fb9-0348-478a-b86b-485bb59e5650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105066 Sep 01 14:03:53.193329 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 467/941] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 14:03:53 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:54.671535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d40ff85-321a-4ac4-90ec-bd8f003d6f6e", "tag": "f4d7227f-8d08-46e0-a285-a83e8102516b"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:54.684447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.686278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.686974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.703300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] Creating event network-changed:f4d7227f-8d08-46e0-a285-a83e8102516b for instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e on hv-cinder-83976 Sep 01 14:03:54.709075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-31020639-fda4-448d-9099-8d29e6a994ea req-08fd1324-e2c7-444a-9c22-f7875c82315e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041817 Sep 01 14:03:54.710480 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 475/942] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:58.486121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7783ae59-03c5-4dd6-b69b-42a21768c854 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'create', calling method: .version_select at 0x7f980ecfa430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-999722296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDW2ASJ3QbTNIzU2BvhOUfFcO0D87DLDkoZcudHXrLTQsh+A44Lg1EpxRUlOPuahBW2F9FT4rQU/kDGmuRMk0G39wexi+v8fpe/ZLf7vXYrc9LfIH20GmxTGJu4nf8EbA=="}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:58.502394 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-7783ae59-03c5-4dd6-b69b-42a21768c854 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Getting quotas for project dd649af3d995442da36bf903376dff24. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:58.506208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-7783ae59-03c5-4dd6-b69b-42a21768c854 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Getting quotas for user 348780f9d8764fadb0564b7187c2c45a and project dd649af3d995442da36bf903376dff24. Resources: {'key_pairs'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:58.581436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7783ae59-03c5-4dd6-b69b-42a21768c854 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.099718 Sep 01 14:03:58.582078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 468/943] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:03:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:58.634622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1210133216", "imageRef": "497f4108-fffe-4afe-9f2c-c9ee2e5eec35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-999722296", "networks": [{"uuid": "2c359762-d1d3-4183-85e4-3b843d8f57b4"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:58.689803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] validate_networks() for [('2c359762-d1d3-4183-85e4-3b843d8f57b4', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:03:59.096246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:03:59.096669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:03:59.097143 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:03:59.097686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:03:59.098097 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:03:59.107876 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.108436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.108839 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.109575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.110032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.110458 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.128942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Getting quotas for project dd649af3d995442da36bf903376dff24. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:59.133446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Getting quotas for user 348780f9d8764fadb0564b7187c2c45a and project dd649af3d995442da36bf903376dff24. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:59.145663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:03:59.148039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='497f4108-fffe-4afe-9f2c-c9ee2e5eec35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:03:59.364247 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8f841c70-f522-4aa4-8338-9610a3cca1d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733758 Sep 01 14:03:59.364819 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 476/944] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:03:59.375792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dc2ba66b-7a8e-485a-8148-9d7d84cf03aa tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:59.376404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dc2ba66b-7a8e-485a-8148-9d7d84cf03aa tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:59.431715 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-dc2ba66b-7a8e-485a-8148-9d7d84cf03aa tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:59.444064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dc2ba66b-7a8e-485a-8148-9d7d84cf03aa tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1258 microversion: 2.1 time: 0.067956 Sep 01 14:03:59.444064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 469/945] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:59 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:00.460800 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-85429c6e-9551-4a0c-89ac-61332228fdf4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:00.461555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-85429c6e-9551-4a0c-89ac-61332228fdf4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:00.517301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-85429c6e-9551-4a0c-89ac-61332228fdf4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.524342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-85429c6e-9551-4a0c-89ac-61332228fdf4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1258 microversion: 2.1 time: 0.067420 Sep 01 14:04:00.525316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 477/946] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:00 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:01.546814 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:01.550478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:01.555672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.556314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.556879 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.557725 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.558284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.558887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.628318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.637939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2c93c8a2-9a2c-4787-9ff8-e96ed9e60316 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1254 microversion: 2.1 time: 0.095481 Sep 01 14:04:01.638530 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 470/947] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:01 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1254 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:02.659864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:02.660519 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:02.662675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:02.668257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.668771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.669803 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.670558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.671013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.671636 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.765712 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:02.774015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cd951206-1445-4021-8d73-ac6db5805e91 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1328 microversion: 2.1 time: 0.118184 Sep 01 14:04:02.775455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 478/948] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:02 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:03.795121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:03.796480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:03.804954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.814510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.814510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.814510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.814510 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.815228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.000244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.013169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e960098a-d11d-40f2-941a-40d8713b2fd4 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.221834 Sep 01 14:04:04.013759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 471/949] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:03 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:04.491257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:04.502984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.503390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.504044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.519014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] Creating event network-changed:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:04:04.529216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-b8908f1a-ab49-4d81-bda9-7dbf1f48b752 req-432ac95f-cc4c-4494-89e0-89701271f332 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Sep 01 14:04:04.530146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 479/950] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:05.038926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.039895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.047148 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.047961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.048401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.049121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.049603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.050033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.208381 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.217491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5bf7ce3d-b9e5-4d49-ab55-5987a69eeffc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.184357 Sep 01 14:04:05.218073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 472/951] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:06.241196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:06.242634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:06.250452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.251061 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.251541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:06.252248 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.252695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.253113 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:06.416826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:06.429988 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2286d6c7-2090-4172-b1e3-e8905e6b29a0 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.195101 Sep 01 14:04:06.430835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 480/952] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:06 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:07.458272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:07.458962 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:07.462022 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:07.467885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.468467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.468903 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.477604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.477604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.477604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.477604 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=57 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:07.654486 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:07.663708 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-59409767-73b9-4008-a48f-3005186ae738 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.209062 Sep 01 14:04:07.664692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 473/953] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:07 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:08.689411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:08.690551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:08.700062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.701436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.702629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.704156 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.705486 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.707591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:09.058760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:09.058760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=67 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:09.058760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-07a21614-50e5-47c3-8a21-3a3f8407970e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.292639 Sep 01 14:04:09.058760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 481/954] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:08 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:10.015217 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:10.016682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:10.021104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:10.029680 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.030736 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.031560 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.032813 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.033621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.034382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.195265 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.212367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6c1b490b-1c06-4f3a-9cd8-6e6d97864a59 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.204245 Sep 01 14:04:10.228553 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 474/955] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:10 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:11.252402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:11.254827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:11.258263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:11.261164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=8 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:11.268999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.269584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.270155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.271068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.271730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.272253 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.519414 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.534537 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b04a94d5-4f52-46cb-9776-eafd993ffb86 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.289114 Sep 01 14:04:11.537182 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 482/956] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:11 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:12.580135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:12.581251 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:12.588697 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.590420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.590420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.590420 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.591019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.591483 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.925375 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:12.934223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c1014d25-d435-42e2-a338-6e28e2c86c63 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.362554 Sep 01 14:04:12.934816 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 475/957] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:12 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:13.954358 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:13.955046 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:13.963316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.963827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.964262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:13.964959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.965408 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.965825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.160430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.169051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1ab530e4-5e1e-4a85-8046-e7ffab5303dc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.218493 Sep 01 14:04:14.169644 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 483/958] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:13 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:15.190595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:15.191233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:15.198081 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.198567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.199001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.199767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.200221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.200650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.343209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:15.355742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-db4130b0-a305-45af-926a-284e0c529d70 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.168643 Sep 01 14:04:15.356829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 476/959] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:15 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:16.390999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:16.391606 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:16.398358 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.398843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.399277 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.400013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.400464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.400883 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.542158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.551015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a0431912-3561-43b5-a1fc-5999e717941e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.163875 Sep 01 14:04:16.551655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 484/960] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:16 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:17.549759 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "name": "network-vif-plugged", "status": "completed", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:17.560611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.561109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.561540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.573070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:17.573070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:17.574946 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] Creating event network-vif-plugged:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:04:17.580629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.581121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.581286 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-00ecdb08-d51a-4491-8d6d-fc9639d2504a req-eccca648-c5a2-4d31-9143-825426de5158 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034728 Sep 01 14:04:17.581652 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.581829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 477/961] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:17.582472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.582923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.583441 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.738633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:17.777099 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5c6bfb61-e845-4552-bc2a-bbb33ac923cc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.179781 Sep 01 14:04:17.777099 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 485/962] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:17 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:18.769531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:18.770389 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:18.777901 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.778399 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.778877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.779713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.780211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.780673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.926206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:18.937961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cbae3b98-1fb2-4618-9de1-c2fa2bcf003e tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1358 microversion: 2.1 time: 0.173302 Sep 01 14:04:18.938555 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 478/963] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:18 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:19.959017 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:19.959645 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:19.966818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.967294 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.967764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.968449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.968895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.969312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.097977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.106696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5d05224c-3e3c-461c-959b-28e2e2926840 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1548 microversion: 2.1 time: 0.151443 Sep 01 14:04:20.109320 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 486/964] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:19 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:20.127889 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.128556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.135769 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.136264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.136696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.137400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.137852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.138273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.277999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.286303 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d2d5879e-9a9d-4889-bc97-be222cb8f21a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1548 microversion: 2.1 time: 0.162233 Sep 01 14:04:20.286898 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 479/965] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:20.306599 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.311864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.312638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Searching by: {'deleted': False, 'project_id': 'dd649af3d995442da36bf903376dff24'} {{(pid=127709) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 14:04:20.319489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.319978 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.320410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.321169 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.321620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.322615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.414442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.multi_cell_list [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127709) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 14:04:20.512300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b4a586b8-fdd5-497a-ae88-04274962145f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209929 Sep 01 14:04:20.513069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 487/966] 10.222.0.50 () {58 vars in 1125 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:20.524121 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.524732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.530580 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.531052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.531542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.532223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.532662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.533079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.671455 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.679323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d964f7e2-8570-4526-b7a6-d8c9bd3459b2 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1548 microversion: 2.1 time: 0.159050 Sep 01 14:04:20.679933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 480/967] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:23.199331 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32a92c29-c000-4ca6-bfc7-10c268765fa6"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:23.201643 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:23.208511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.209000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.209437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.210137 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.210590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.211035 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.057992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-008d13f3-629d-4cf1-b014-6b675858e940 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863182 Sep 01 14:04:24.062279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 488/968] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:04:23 2022] POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:31.131610 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.132202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.134607 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=15 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:31.135258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=43 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:31.140132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.140609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.141036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.141724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.142168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.142585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.167860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7310c8be-883f-4ea4-a7ba-9d58c7b7a2ea tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/ips" status: 200 len: 148 microversion: 2.1 time: 0.040327 Sep 01 14:04:31.168437 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 481/969] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:31.745589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:31.749887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.750611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.757130 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.758560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.758560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.759430 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.759707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.760124 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.932010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:31.948044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-07ba55f1-075f-4d5e-8c18-d2ca70ecda8b tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1594 microversion: 2.1 time: 0.203372 Sep 01 14:04:31.949109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 489/970] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:33.015854 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:33.018424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:33.026115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.026601 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.027156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.027904 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.028359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.028779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.184849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a25fff44-77f2-4a21-acd2-1ad26a5145ec tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172913 Sep 01 14:04:34.186012 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 482/971] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:04:33 2022] POST /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:34.489410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:34.500982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.501459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.501891 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.515258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] Creating event network-changed:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:04:34.520916 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-b440cca3-307d-42b6-9f6f-6a4e86b4291b req-9518d92e-7953-4877-a3d8-196c536ef090 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035489 Sep 01 14:04:34.524893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 490/972] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:37.945518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1265099923"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:37.946728 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:37.953724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.954221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.954661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.955409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.955869 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.956297 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.106124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.network.security_group_api [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Adding security group b44e445c-f616-4999-9fb4-da05219c1e0e to port 1e8beb9a-433b-4efc-899c-17fd9d1cb3ab Sep 01 14:04:38.555315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d7f7acae-e436-4d23-b6c4-33c0275fc5cd tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action" status: 202 len: 0 microversion: 2.1 time: 0.614634 Sep 01 14:04:38.561436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 483/973] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:37 2022] POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:38.567810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:38.569343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:38.570308 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:38.577660 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.578138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=26 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:38.578700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.579335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.580322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.580932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.581159 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.581467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.581923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.582305 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.596634 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] Creating event network-changed:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:04:38.604048 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-8add68aa-d1a1-4402-b5be-e7c0b7edf41b req-447f4c2f-7704-4f1d-93c0-a22fa93c6360 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041223 Sep 01 14:04:38.605184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 491/974] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:38.848475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:38.865537 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-572fa0b6-9a77-4a6b-9d20-2e1a6d8f2206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1760 microversion: 2.1 time: 0.299934 Sep 01 14:04:38.866331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 484/975] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:38 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1760 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:41.840554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-06c7bb99-9bdd-4632-84e9-d904263add18 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: .version_select at 0x7f980ed85d30>, body: {"keypair": {"name": "tempest-keypair-190029540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuhGSOaEPkNOG++QFVAYjToYaVnknJBmxjbo7OJbXHyV10zbi1kJJ+jhaA2lwgyBqFLFF1beNigl/jOTrPLMOPHiKxygSV8PUdqDGsf2Ktdhe8T1zYu5bkc+EBoeMtlcg=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:41.858958 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-06c7bb99-9bdd-4632-84e9-d904263add18 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:04:41.863894 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-06c7bb99-9bdd-4632-84e9-d904263add18 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:04:41.985746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-06c7bb99-9bdd-4632-84e9-d904263add18 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151235 Sep 01 14:04:41.986317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 492/976] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:04:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:44.332310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-667946955", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1e67750-0db8-4b1a-a617-db488366bcfd"}], "security_groups": [{"name": "tempest-securitygroup--444264901"}], "key_name": "tempest-keypair-190029540", "user_data": "}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:44.444334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] validate_networks() for [('d1e67750-0db8-4b1a-a617-db488366bcfd', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:04:45.150779 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:04:45.151195 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:04:45.151695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:04:45.152095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:04:45.152503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:04:45.162249 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.162721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.163153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.163907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.164458 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.165087 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.192800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:04:45.199043 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:04:45.212490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:04:45.214800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:04:45.376934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cea83aa4-bf89-4cad-8fe9-36579c1fa8d9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.050865 Sep 01 14:04:45.378023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 485/977] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:04:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:04:45.392761 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9fe541dd-538f-4241-9fbc-4aca2e0c2f30 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:45.394090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9fe541dd-538f-4241-9fbc-4aca2e0c2f30 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:45.479278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-9fe541dd-538f-4241-9fbc-4aca2e0c2f30 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:45.486869 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9fe541dd-538f-4241-9fbc-4aca2e0c2f30 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1240 microversion: 2.1 time: 0.101647 Sep 01 14:04:45.487749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 493/978] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:45 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:46.510459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:46.511830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:46.520924 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.521726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.522168 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.522978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.523383 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.524390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.590583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.599620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5212372f-1c6d-4341-9074-6aec0180302b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1244 microversion: 2.1 time: 0.093816 Sep 01 14:04:46.600327 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 486/979] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:46 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:47.626489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:47.628022 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:47.642008 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.642880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.643697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.645013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.645849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.646646 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.652407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:47.768493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:47.779833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d6bfac08-edae-4d45-bf8c-84946a3e099d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1300 microversion: 2.1 time: 0.160817 Sep 01 14:04:47.780826 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 494/980] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:47 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:48.809535 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:48.810252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:48.818339 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.822598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.822598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.822598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.822598 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.823138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.011758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:49.025247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-bb230758-ee22-4e29-9e50-2afc3c48b34b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.219829 Sep 01 14:04:49.026360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 487/981] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:48 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:50.020294 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c", "tag": "a36a4897-c758-4f7e-9a65-83d2a92fdfec"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:50.032166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.032633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.033062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.045935 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] Creating event network-changed:a36a4897-c758-4f7e-9a65-83d2a92fdfec for instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c on hv-cinder-83976 Sep 01 14:04:50.051262 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-99c3ad06-17be-4a08-b0a8-6913e2fa1472 req-527ab049-0a99-44dd-b73e-e227760e0738 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034818 Sep 01 14:04:50.052398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 495/982] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:50.054367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:50.056260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:50.067944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.068818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.069613 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.071896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.073034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.073868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.278039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:50.287767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-2e34a572-eb19-4d1d-bd4d-948d1955cfff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.240492 Sep 01 14:04:50.291491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 488/983] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:50 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:51.320010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:51.320971 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:51.332569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.332569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.332569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.332569 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.333168 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.333168 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.503423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:51.512313 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-01d66e2e-66f0-4262-8521-251137cb1644 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.196565 Sep 01 14:04:51.512907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 496/984] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:51 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:52.533402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:52.534028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:52.541390 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.541907 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.547961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:52.547961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.547961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.547961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:52.701034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:52.708923 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1cfcfdee-28c3-45c6-bf5b-a2a68439f1ff tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.179407 Sep 01 14:04:52.709501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 489/985] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:52 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:53.730855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:53.731534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:53.738091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.738573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.739007 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.739751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.740197 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.740615 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.880831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:53.890969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-dc02e3d0-50a3-49d6-8396-0f1ae7f1edfb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.163846 Sep 01 14:04:53.892720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 497/986] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:53 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:54.915057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:54.915843 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:54.922728 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.923210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.923689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.924404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.924938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.925423 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.068844 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:55.077142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-831ec521-fc41-408a-b083-f409d2f3665c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.166505 Sep 01 14:04:55.077719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 490/987] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:54 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:55.839795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c", "name": "network-vif-plugged", "status": "completed", "tag": "a36a4897-c758-4f7e-9a65-83d2a92fdfec"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:55.843834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:55.849547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.850029 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.850512 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.863144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] Creating event network-vif-plugged:a36a4897-c758-4f7e-9a65-83d2a92fdfec for instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c on hv-cinder-83976 Sep 01 14:04:55.868417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-3275c42a-eb86-49ac-a664-f20d4aa30621 req-22bdf386-a7fd-4679-9d8e-b5085a041977 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Sep 01 14:04:55.869110 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 498/988] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:55.916641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:55.921425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:55.921425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:55.921803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:55.927843 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.928340 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.929287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.929481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.929919 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.930342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.099841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:56.100468 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:56.107317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.107859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.108295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.109005 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.109455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.109880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.240639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3382aa42-a6e7-4aad-8b9a-496912dd58a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action" status: 202 len: 0 microversion: 2.1 time: 0.327741 Sep 01 14:04:56.245606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 491/989] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:55 2022] POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:56.249875 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:56.251003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:56.251956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:56.256697 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6882fed8-ce3e-4a55-bf01-a1b6fc7b33b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.161459 Sep 01 14:04:56.257931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 499/990] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:56 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:56.259799 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.260258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.260694 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.261404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.261918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.262351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.426380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:56.435336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-837db3e5-60ba-47e8-9395-cff1b8754206 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1752 microversion: 2.1 time: 0.188423 Sep 01 14:04:56.435937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 492/991] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:56 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:57.286428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:57.287028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:57.293378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.293855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.295264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.295264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.295504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.295846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.431547 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:57.439210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d1e96f0e-43d0-445e-8170-e20b7edd6c72 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1365 microversion: 2.1 time: 0.156621 Sep 01 14:04:57.439814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 500/992] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:57 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:57.456610 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:57.457321 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:57.464044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.464517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.465006 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.465705 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.466151 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.466569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.617929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:57.626594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-79c45acd-39ac-4490-a07f-c34bab751fce tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1752 microversion: 2.1 time: 0.173860 Sep 01 14:04:57.627164 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 493/993] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:57 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:58.463102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:58.463742 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:58.470531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.471053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.471514 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.472226 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.472681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.473102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.650879 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:58.651405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:58.651664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:58.658294 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.658775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.659196 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.659522 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b7149d25-0749-466b-b010-cfea2138f397 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1554 microversion: 2.1 time: 0.200691 Sep 01 14:04:58.659920 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.660199 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 501/994] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:58 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:58.660518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.660767 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.679899 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:58.680393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:58.686361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.686847 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.687291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.688019 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.688484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.688910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.770699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1b1ecbc5-4547-486e-95b8-61e2d9737c0b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094582 Sep 01 14:04:58.771288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 502/995] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 14:04:58 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:58.823020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:58.831633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e583edc8-7a43-4b22-8f26-afc2af3e0278 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.186974 Sep 01 14:04:58.832228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 494/996] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:58 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:59.854787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:59.855572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:59.862047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:59.863069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:59.863532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:59.864263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:59.864706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:59.865283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:59.889051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c", "tag": "a36a4897-c758-4f7e-9a65-83d2a92fdfec"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:59.901026 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:59.901609 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:59.901987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:59.915063 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] Creating event network-changed:a36a4897-c758-4f7e-9a65-83d2a92fdfec for instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c on hv-cinder-83976 Sep 01 14:04:59.920511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-0269443a-1739-43b6-8952-00d3afca64c8 req-02ae45ec-c2b2-4ee9-a926-087ba9bdbb6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035824 Sep 01 14:04:59.924021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 495/997] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:00.055795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:00.065992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7f39a9dd-780f-4b02-ad87-f8c8f27949ad tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.216540 Sep 01 14:05:00.066598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 503/998] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:59 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:01.095287 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:01.095936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:01.103223 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:01.103936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:01.104322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:01.105109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:01.105572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:01.106091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:01.258071 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:01.266955 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6a5b538a-53f2-4c5e-adba-273246ffb3c7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.176245 Sep 01 14:05:01.267586 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 496/999] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:01 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:02.289200 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:02.289818 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:02.296482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:02.297043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:02.297481 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:02.298205 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:02.298658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:02.299084 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:02.450668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:02.459342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c00d6453-bdfe-408e-be36-9e543b6ede56 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.174140 Sep 01 14:05:02.459942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 504/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:02 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:03.483169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:03.483169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:03.484726 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:03.489897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.490365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.490795 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.491537 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.492642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.493066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.496544 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:03.657667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:03.667748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6e6be5cc-34f1-41d9-9495-fbf703c3d4d8 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.191087 Sep 01 14:05:03.668336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 497/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:03 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:04.690032 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:04.697639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:04.697937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:04.698420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:04.698848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:04.699578 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:04.700028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:04.700443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:04.864106 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:04.873028 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fdc3dc9e-9996-41c9-bd37-fa83bfa2469c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.187509 Sep 01 14:05:04.873631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 505/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:04 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:05.895494 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:05.896325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:05.903977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:05.904459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:05.904895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:05.905607 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:05.906054 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:05.906476 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:06.090700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:06.099856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-adba4bc5-895d-40b0-98f9-ed2abc2dfcb3 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.208673 Sep 01 14:05:06.100536 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 498/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:05 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:07.123095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:07.123746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:07.131306 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:07.131820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:07.132259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:07.133469 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:07.133940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:07.134361 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:07.323138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:07.332465 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d6e58af3-b5fa-4a09-b661-781a88ec8456 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.213607 Sep 01 14:05:07.333068 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 506/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:07 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:08.355965 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:08.356641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:08.363703 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:08.364189 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:08.364620 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:08.365318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:08.365760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:08.366175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:08.518311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:08.527594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1fa6b449-4f05-402f-930d-af36d7523f0c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1757 microversion: 2.1 time: 0.176102 Sep 01 14:05:08.528169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 499/1005] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:08 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:09.554229 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:09.555533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:09.568503 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.569383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.569992 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:09.570893 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.571768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.572534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:09.760632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:09.768828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-0e5f82ca-921a-4f79-86d3-f8a72e8a27bc tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1760 microversion: 2.1 time: 0.222270 Sep 01 14:05:09.769387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 507/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:09 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1760 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:36.036777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:36.037962 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:36.039749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=5 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:36.040466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=17 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:36.046042 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.046514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.046939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.047662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.048111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.048532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.072653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0f05aa39-cdbd-4552-9aa8-c8426fbc44b9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039935 Sep 01 14:05:36.073214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 500/1007] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:05:36 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:36.084678 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:36.089584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:36.089584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:36.090237 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=73 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:36.094922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.095475 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.095902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.096589 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.097030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.097445 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.180478 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: POST /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/os-volume_attachments HTTP/1.1 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 74 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:05:36.182280 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {"volumeAttachment": {"volumeId": "e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f"}} Sep 01 14:05:36.184629 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'server_id': 'a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c', 'body': {'volumeAttachment': {'volumeId': 'e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f'}}} Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.185543 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.186895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 400 to user: Invalid volume: volume e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f is already attached to instances: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e49c3aa3-107a-4c8a-a99c-1857346ab264 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103874 Sep 01 14:05:36.195749 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 508/1008] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:05:36 2022] POST /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:05:36.196444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:36.196444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:36.200758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.201233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.201667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.202347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.202793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.203258 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.228322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:05:36.503775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-890f6f5f-4615-4fb4-aeaa-d31f7ff819fb tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 204 len: 0 microversion: 2.1 time: 0.314223 Sep 01 14:05:36.504360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 501/1009] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:05:36 2022] DELETE /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:05:36.512680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:36.514351 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:36.521228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.521704 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.522127 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.522942 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.523400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.523840 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.660342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:36.668759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c35916a2-4299-4249-afc3-0176264d8001 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1679 microversion: 2.1 time: 0.160010 Sep 01 14:05:36.669323 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 509/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:36 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:37.691585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:37.692298 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:37.698973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:37.699502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:37.699969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:37.700673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:37.701123 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:37.701548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:37.844269 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:37.859059 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-db2aa9d6-f848-4223-9ae8-75274b5d4791 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1679 microversion: 2.1 time: 0.171376 Sep 01 14:05:37.860183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 502/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:37 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:38.881086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:38.881733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:38.889058 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:38.889648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:38.889959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:38.890865 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:38.891312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:38.891765 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:38.960024 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:38.974603 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d2d6c583-012b-478b-96c4-1ce56c759d3f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1612 microversion: 2.1 time: 0.097019 Sep 01 14:05:38.975977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 510/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:38 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1612 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:39.211404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c", "name": "network-vif-deleted", "tag": "a36a4897-c758-4f7e-9a65-83d2a92fdfec"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:39.222008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:39.222478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:39.223108 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:39.237068 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] Creating event network-vif-deleted:a36a4897-c758-4f7e-9a65-83d2a92fdfec for instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c on hv-cinder-83976 Sep 01 14:05:39.243753 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-3e34a12f-c7b5-4eaa-a4b4-430eb74fa925 req-7868aaa4-6d0e-4e50-8e75-08116f02a69e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120958 Sep 01 14:05:39.244591 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 503/1013] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:40.015649 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:40.016861 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:40.029355 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.030270 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.031093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.032513 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.033372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.034163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.078670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.079187 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.080409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.080409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'fault' on Instance uuid a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:40.132655 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:40.144285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8df2067a-603a-436a-bbd8-570b6846218f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 200 len: 1330 microversion: 2.1 time: 0.136667 Sep 01 14:05:40.144873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 511/1014] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:40 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:41.174199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.174811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:41.181138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.181615 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.182047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.182768 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.183208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.183658 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.197259 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c HTTP/1.1 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:05:41.198916 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:05:41.200589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c'} Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:41.201830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:05:41.204256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:41.205870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:41.205870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-20ab76d7-083f-44d2-8ad6-163c9a6e600c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 404 len: 111 microversion: 2.1 time: 0.031035 Sep 01 14:05:41.205870 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 504/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:41 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:41.209349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3836e88a-21aa-4cc3-931b-1c3a2ffdb41d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '.version_select at 0x7f980ef74ee0>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.304584 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3836e88a-21aa-4cc3-931b-1c3a2ffdb41d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-190029540" status: 202 len: 0 microversion: 2.1 time: 0.098919 Sep 01 14:05:41.305375 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 512/1016] 10.222.0.50 () {58 vars in 1218 bytes} [Thu Sep 1 14:05:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-190029540 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:42.467811 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.468343 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:42.474852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.475337 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.475803 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.476502 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.476952 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.477374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.559611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'services' on Instance uuid 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:42.754852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e23c82a4-9799-4427-9c20-0777406a71c9 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments/e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f" status: 202 len: 0 microversion: 2.1 time: 0.290922 Sep 01 14:05:42.755471 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 505/1017] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:05:42 2022] DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments/e86dbbdc-124a-4eb1-b28d-1a2e25e20c7f => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:42.764620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.766821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:42.773852 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.774339 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.774774 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.775502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.775969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.776379 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.806855 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-64c80e75-a54d-44cc-9f28-801c3e55ef2b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Sep 01 14:05:42.807434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 513/1018] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:43.823824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:43.827738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:43.836204 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.836949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.838541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.839818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.841194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.841931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.896285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0d4eedc0-2286-4c9e-9112-a83afc312435 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078572 Sep 01 14:05:43.896860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 506/1019] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:43 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:44.706967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1265099923"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:44.707709 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:44.714701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.715193 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.715656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.716363 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.716810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.717223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.888134 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.network.security_group_api [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Removing security group b44e445c-f616-4999-9fb4-da05219c1e0e from port 1e8beb9a-433b-4efc-899c-17fd9d1cb3ab Sep 01 14:05:44.909950 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:44.912269 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:44.920270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.920761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.921206 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.921914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.922359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.922776 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.969515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-461d10b3-b74d-4517-8cae-417a774b3d8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062975 Sep 01 14:05:44.970485 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 507/1020] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:44 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:05:45.060821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:45.061505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:45.068257 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.077829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.077829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.077829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.077829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.078278 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.097717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:05:45.421240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3a9408bd-ea87-44e7-9489-930a450b465c tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action" status: 202 len: 0 microversion: 2.1 time: 0.718386 Sep 01 14:05:45.425699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 514/1021] 10.222.0.50 () {60 vars in 1278 bytes} [Thu Sep 1 14:05:44 2022] POST /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:45.494405 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-04e8832e-3a0c-4a86-953a-8e1e63af733a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 204 len: 0 microversion: 2.1 time: 0.437519 Sep 01 14:05:45.496987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 508/1022] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:05:45 2022] DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:05:45.507376 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:45.508743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:45.515397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.516034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.516681 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.517167 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:45.517460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.517962 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.518569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.530719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.531653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.532374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.548474 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] Creating event network-changed:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:05:45.554910 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-201129b4-2423-4514-b37e-8742619bb924 req-1649f36a-acf0-4164-b6a5-65e9f2230997 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124496 Sep 01 14:05:45.560816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 515/1023] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:45.748363 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:45.761773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c30bfd5c-5f8d-478e-aa28-375b4ac88a27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1681 microversion: 2.1 time: 0.259809 Sep 01 14:05:45.762349 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 509/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:45 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:46.785476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.786212 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:46.792817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.793300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.793760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.794457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.794901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.795315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.914086 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.915201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:46.922860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.923487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.924113 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.925027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.925487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.925915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.997850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:47.007565 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2c12a4d3-5c2e-4d1e-b405-ae337678ecfa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1681 microversion: 2.1 time: 0.227164 Sep 01 14:05:47.008158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 516/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:46 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:47.021847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lazy-loading 'services' on Instance uuid 0e58a637-5dde-4029-8cb2-81c300a197a7 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:47.231227 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ddc55a70-683d-4de8-9b23-4284852aaa27 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments/32a92c29-c000-4ca6-bfc7-10c268765fa6" status: 202 len: 0 microversion: 2.1 time: 0.321029 Sep 01 14:05:47.235183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 510/1026] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:05:46 2022] DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments/32a92c29-c000-4ca6-bfc7-10c268765fa6 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:47.241758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:47.244590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:47.253548 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:47.254042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:47.254709 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:47.255472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:47.256042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:47.256344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:47.292842 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-eb2ca695-4da2-4d16-9b70-0c442d7dcb3f tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055768 Sep 01 14:05:47.294376 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 517/1027] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:47 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:47.576886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:47.589261 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:47.589748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:47.590396 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:47.604847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] Creating event network-changed:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:05:47.619650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-508e43f9-ccb3-4782-b8c2-b0806ebd45c2 req-94e51c2c-f46c-4999-9789-7bd6371d691c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048394 Sep 01 14:05:47.620264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 511/1028] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:48.044338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:48.044963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:48.052825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.053730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.054242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.054998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.055606 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.055956 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.189295 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:48.205669 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b55d11e1-3a8d-4376-b23b-e4f944000e22 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1613 microversion: 2.1 time: 0.165364 Sep 01 14:05:48.207079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 518/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:48 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:48.306297 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:48.312773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:48.319487 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.320468 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.321684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.322752 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.323929 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.325039 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.358883 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d1a47033-1b45-48c7-9724-4e1f93ad8c09 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057231 Sep 01 14:05:48.359662 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 512/1030] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:48 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:49.228954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.229843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:49.237276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.237763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.238449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.239151 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.239638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.240056 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.277909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.278419 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.278850 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.279300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'fault' on Instance uuid 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:49.323920 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:49.332014 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e5fe7a81-9126-4668-8942-b3cbb8b0878b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 200 len: 1332 microversion: 2.1 time: 0.107560 Sep 01 14:05:49.332610 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 519/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:49 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:49.372336 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.374691 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:49.382254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.383045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.383670 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.384600 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.385055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.385484 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.417667 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-11ea55ee-ab21-41b2-adb6-8ddd2ad25883 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049854 Sep 01 14:05:49.419263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 513/1032] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:49 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:05:49.429535 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.430147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:49.437796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.438278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.438712 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.439472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.439921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.440524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.528057 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] HTTP exception thrown: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 is not attached to volume 32a92c29-c000-4ca6-bfc7-10c268765fa6 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Request method failure captured: Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments/32a92c29-c000-4ca6-bfc7-10c268765fa6 HTTP/1.1 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELu6tCgxHcxU4dQI4RVLHz9w08nhrg5YE2BBAjZmOSpCOM3SG9Gh3IjXPlJeG6HNfJFCAJZGT2HoV_9Wwg7k26N4QxJIhQxYH4IFERHqMth58U8fgEIxB2zUm6Q8Ej6Dqat_jTw5N2NHn5Lz0ycaQhu8blu0TDeTo3ehY2QNlEDH3nY Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: dd649af3d995442da36bf903376dff24 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:05:49.530460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd649af3d995442da36bf903376dff24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd649af3d995442da36bf903376dff24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd649af3d995442da36bf903376dff24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd649af3d995442da36bf903376dff24"}]}] Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: dd649af3d995442da36bf903376dff24 Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-TestMinimumBasicScenario-1466935584-project Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 348780f9d8764fadb0564b7187c2c45a Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-TestMinimumBasicScenario-1466935584-project Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:05:49.532324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 is not attached to volume 32a92c29-c000-4ca6-bfc7-10c268765fa6 Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'server_id': '0e58a637-5dde-4029-8cb2-81c300a197a7', 'id': '32a92c29-c000-4ca6-bfc7-10c268765fa6'} Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 32a92c29-c000-4ca6-bfc7-10c268765fa6. Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:49.536778 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 is not attached to volume 32a92c29-c000-4ca6-bfc7-10c268765fa6 Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 is not attached to volume 32a92c29-c000-4ca6-bfc7-10c268765fa6 Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:49.538269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Returning 404 to user: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 is not attached to volume 32a92c29-c000-4ca6-bfc7-10c268765fa6 {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:49.540051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4eb250eb-866c-4f54-8423-18e562e4a99a tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments/32a92c29-c000-4ca6-bfc7-10c268765fa6" status: 404 len: 154 microversion: 2.1 time: 0.106786 Sep 01 14:05:49.540051 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 520/1033] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:05:49 2022] DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7/os-volume_attachments/32a92c29-c000-4ca6-bfc7-10c268765fa6 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:49.637563 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d40ff85-321a-4ac4-90ec-bd8f003d6f6e", "name": "network-vif-deleted", "tag": "f4d7227f-8d08-46e0-a285-a83e8102516b"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:49.648260 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.648734 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.649163 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.654460 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:49.663565 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] Creating event network-vif-deleted:f4d7227f-8d08-46e0-a285-a83e8102516b for instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e on hv-cinder-83976 Sep 01 14:05:49.670167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-b7e85d88-e4eb-4a57-a7ab-6b3cc0c17a2c req-4dbd82bf-83ea-4b67-aded-c9790c654ae8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036467 Sep 01 14:05:49.670772 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 514/1034] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:50.354160 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:50.354789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:50.361091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.361579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.362013 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.362716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.363450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.363973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.378912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e HTTP/1.1 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:05:50.380488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:05:50.382246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '0d40ff85-321a-4ac4-90ec-bd8f003d6f6e'} Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:50.383318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:05:50.384924 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:05:50.386340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:50.386340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a5754d25-0bc2-4e50-9fc7-f3e79ddc776a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 404 len: 111 microversion: 2.1 time: 0.032496 Sep 01 14:05:50.386340 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 521/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:50 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:50.393334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-951e5de1-c4d2-4a90-8ec0-2d9f3ba02461 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '.version_select at 0x7f980ec41700>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:50.504102 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-951e5de1-c4d2-4a90-8ec0-2d9f3ba02461 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437429806" status: 202 len: 0 microversion: 2.1 time: 0.115947 Sep 01 14:05:50.504739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 515/1036] 10.222.0.50 () {58 vars in 1221 bytes} [Thu Sep 1 14:05:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437429806 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:50.877976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:50.878494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:50.884729 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.885223 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.885663 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.886358 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.886811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.887234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.912352 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:05:51.211453 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-68144170-02b1-48df-b276-328b186d02b9 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 204 len: 0 microversion: 2.1 time: 0.337032 Sep 01 14:05:51.212062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 522/1037] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:05:50 2022] DELETE /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:05:51.221632 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:51.222372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:51.229645 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.230139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.231164 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.232330 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.232808 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.233266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.266333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c163b482-f08a-4ff1-9638-6bce1fbdb05b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: .version_select at 0x7f980ed46dc0>, body: {"keypair": {"name": "tempest-keypair-910321730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4+C1sDo7QeSWqRav/xNgSLVcE2wy+7I4lq5h/P7rNTEgw41FJ0NxZ4R8SAo+EV5ixdk5LKnrkAFSOqkTEWBqf1bLj6mq2Ck7VmgTeNhmZOdvc+Z4cwNnfxCY1Qtb1zWQ=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:51.291524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-c163b482-f08a-4ff1-9638-6bce1fbdb05b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:51.297759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-c163b482-f08a-4ff1-9638-6bce1fbdb05b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:51.385887 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c163b482-f08a-4ff1-9638-6bce1fbdb05b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124171 Sep 01 14:05:51.387100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:51.387224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 523/1038] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:05:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:51.395124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6fe90d4b-4400-4210-af3a-88e3b83040a5 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1554 microversion: 2.1 time: 0.177387 Sep 01 14:05:51.399391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 516/1039] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:51 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:52.420523 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:52.421400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:52.429233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.429730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.430198 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.430909 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.431517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.432312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.581281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.589843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-579fedab-abdc-4292-aeb3-77336da19585 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1554 microversion: 2.1 time: 0.173848 Sep 01 14:05:52.590438 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 524/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:52 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:53.613593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.614200 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:53.621781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.622271 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.622704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.623482 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.623936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.624354 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.937031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.946422 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-376b81c0-284a-421c-9f41-5b039f19b1d7 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1554 microversion: 2.1 time: 0.337345 Sep 01 14:05:53.947129 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 517/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:53 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:54.290833 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e58a637-5dde-4029-8cb2-81c300a197a7", "name": "network-vif-deleted", "tag": "1e8beb9a-433b-4efc-899c-17fd9d1cb3ab"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:54.301063 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.301540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.301967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.314681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] Creating event network-vif-deleted:1e8beb9a-433b-4efc-899c-17fd9d1cb3ab for instance 0e58a637-5dde-4029-8cb2-81c300a197a7 on hv-cinder-83976 Sep 01 14:05:54.322117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-9efb74fb-e611-4cfa-b122-a7638d766462 req-373dc82e-e273-40ac-b3c7-01c469782e12 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Sep 01 14:05:54.322117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 525/1042] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:54.425655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2099006463", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1e67750-0db8-4b1a-a617-db488366bcfd"}], "security_groups": [{"name": "tempest-securitygroup--787454912"}], "key_name": "tempest-keypair-910321730", "user_data": "}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:54.545331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] validate_networks() for [('d1e67750-0db8-4b1a-a617-db488366bcfd', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:54.969577 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:54.970271 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:54.976659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.977150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.977679 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.978413 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.978889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.979399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.998947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:55.004272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:55.004809 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:55.005416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:55.005824 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:55.006233 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:55.013044 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.013521 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.013945 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.014562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lazy-loading 'fault' on Instance uuid 0e58a637-5dde-4029-8cb2-81c300a197a7 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:55.017429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.017429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.017429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.017717 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.018070 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.018493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.036000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:55.041805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:55.053051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:55.055393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:55.064828 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348780f9d8764fadb0564b7187c2c45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd649af3d995442da36bf903376dff24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.072738 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-79cfee95-638b-443c-b9ee-d34adcc3dd84 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 200 len: 1348 microversion: 2.1 time: 0.107251 Sep 01 14:05:55.080269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 526/1043] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:54 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:55.174781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-23224195-9bd5-4a81-8fd2-64bc7d740b89 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.753651 Sep 01 14:05:55.175341 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 518/1044] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:05:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:05:55.187488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d4ab06f5-d932-445d-ab7a-6c8cbcf02c8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:55.188115 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d4ab06f5-d932-445d-ab7a-6c8cbcf02c8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:55.252572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d4ab06f5-d932-445d-ab7a-6c8cbcf02c8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.259711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d4ab06f5-d932-445d-ab7a-6c8cbcf02c8d tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1241 microversion: 2.1 time: 0.077254 Sep 01 14:05:55.260291 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 527/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:55 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:56.100732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:56.101540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] [instance: 0e58a637-5dde-4029-8cb2-81c300a197a7] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:56.108501 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.108963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.109405 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.110136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.110593 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.111024 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.127174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] HTTP exception thrown: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Request method failure captured: Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 HTTP/1.1 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELu6tCgxHcxU4dQI4RVLHz9w08nhrg5YE2BBAjZmOSpCOM3SG9Gh3IjXPlJeG6HNfJFCAJZGT2HoV_9Wwg7k26N4QxJIhQxYH4IFERHqMth58U8fgEIxB2zUm6Q8Ej6Dqat_jTw5N2NHn5Lz0ycaQhu8blu0TDeTo3ehY2QNlEDH3nY Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: dd649af3d995442da36bf903376dff24 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:05:56.128876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd649af3d995442da36bf903376dff24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd649af3d995442da36bf903376dff24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd649af3d995442da36bf903376dff24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd649af3d995442da36bf903376dff24"}]}] Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: dd649af3d995442da36bf903376dff24 Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1466935584 Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-TestMinimumBasicScenario-1466935584-project Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 348780f9d8764fadb0564b7187c2c45a Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-TestMinimumBasicScenario-1466935584-project Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. Sep 01 14:05:56.130829 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '0e58a637-5dde-4029-8cb2-81c300a197a7'} Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:56.131999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. Sep 01 14:05:56.133554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:05:56.134837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Returning 404 to user: Instance 0e58a637-5dde-4029-8cb2-81c300a197a7 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:56.134837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-a11efdc3-0403-437e-9686-66e4ae602778 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7" status: 404 len: 111 microversion: 2.1 time: 0.034094 Sep 01 14:05:56.134837 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 519/1046] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:56 2022] GET /compute/v2.1/servers/0e58a637-5dde-4029-8cb2-81c300a197a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:56.140213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-32ac6f4a-ad7f-45a7-b51f-5cf564efa219 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] Calling method '.version_select at 0x7f980ed5bb80>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:56.230491 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-32ac6f4a-ad7f-45a7-b51f-5cf564efa219 tempest-TestMinimumBasicScenario-1466935584 tempest-TestMinimumBasicScenario-1466935584-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999722296" status: 202 len: 0 microversion: 2.1 time: 0.095192 Sep 01 14:05:56.231079 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 528/1047] 10.222.0.50 () {58 vars in 1269 bytes} [Thu Sep 1 14:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999722296 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:56.282099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:56.282819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:56.289515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.289944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.290477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.291186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.291689 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.292111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.366057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:56.375055 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-af04be98-e424-4b8f-b6ff-89a83adf1ead tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1245 microversion: 2.1 time: 0.096933 Sep 01 14:05:56.375284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 520/1048] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:56 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:57.397096 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:57.397810 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:57.404661 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.405144 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.410837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.410837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.410837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.410837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.476343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.486431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b818f717-e784-4f4b-9f01-272c4738df1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1301 microversion: 2.1 time: 0.093696 Sep 01 14:05:57.488568 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 529/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:57 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:58.509219 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.510504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:58.522928 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.523288 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.524036 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.524479 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.524931 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.525359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.808978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.819132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-84673e63-a386-4750-b156-48677c9ac249 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.313869 Sep 01 14:05:58.819943 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 521/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:59.504218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f16bac3-e24e-4f15-9bcb-33094a730482", "tag": "96aef23f-1f83-4a28-9f70-13064947e629"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:59.516268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.516959 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.517456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.530575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] Creating event network-changed:96aef23f-1f83-4a28-9f70-13064947e629 for instance 4f16bac3-e24e-4f15-9bcb-33094a730482 on hv-cinder-83976 Sep 01 14:05:59.543073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-74859c79-2000-424e-bd6e-76dfae415b35 req-d4f822e5-6023-4f1b-8b2c-46ada327c202 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042477 Sep 01 14:05:59.543723 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 530/1051] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:59.842404 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:59.843807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:59.851154 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.852097 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.852540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.853402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.853858 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.854368 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:00.159033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:00.172020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7390f25f-bb1d-4620-aa5f-2184b5b58a38 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.334273 Sep 01 14:06:00.173639 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 522/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:59 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:01.200696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:01.201591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:01.221433 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.222730 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.223796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.225390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.226675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.227740 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.415787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:01.424416 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7e58a645-aab1-42f7-9013-16b3cd5d74cf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.233953 Sep 01 14:06:01.425012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 531/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:01 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:02.446229 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:02.446834 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.454489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.455134 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.455807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.456636 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.457194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.457716 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.653402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:02.661706 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-14b58de2-14b7-4e1e-b1ee-56ed38737a4c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.219361 Sep 01 14:06:02.662285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 523/1054] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:02 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:03.682303 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:03.682873 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:03.689717 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.690217 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.690647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.691671 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.692300 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.692721 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:04.123572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:04.134298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-65d65cf9-7d31-467e-bce7-56e91611d45f tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.455910 Sep 01 14:06:04.135799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 532/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:03 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:05.156674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:05.157320 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:05.161551 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:05.166892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=6 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:05.166892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.166892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.166892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.167490 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.167938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.168550 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.427431 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:05.435654 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-45dd2710-76f6-4aee-a060-1904b9918de0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.282729 Sep 01 14:06:05.436652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 524/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:05 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:06.402814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:06.458853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.459507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.460206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f16bac3-e24e-4f15-9bcb-33094a730482", "name": "network-vif-plugged", "status": "completed", "tag": "96aef23f-1f83-4a28-9f70-13064947e629"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:06.461450 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:06.466546 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.467218 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.467954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.468447 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.468968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.469393 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.470631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.471109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.471575 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.483285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] Creating event network-vif-plugged:96aef23f-1f83-4a28-9f70-13064947e629 for instance 4f16bac3-e24e-4f15-9bcb-33094a730482 on hv-cinder-83976 Sep 01 14:06:06.488533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-efdf295e-0b12-426c-b2c2-271db6fe950e req-ff890bca-b21b-4432-bb48-ad4e5beee94e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090755 Sep 01 14:06:06.489349 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 533/1057] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:06.628146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:06.636033 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-72f97001-cb8d-4f3c-9740-714bae3b9b15 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.181477 Sep 01 14:06:06.636603 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 525/1058] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:07.659060 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:07.659785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:07.662070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:07.666948 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.667534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.667963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.668658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.669102 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.669519 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.811716 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:07.819497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e1e36bda-e857-45f9-a856-d9d479947759 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1366 microversion: 2.1 time: 0.165963 Sep 01 14:06:07.820065 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 534/1059] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:07 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:08.846291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:08.847028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:08.854049 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.854576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.855008 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.855743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.856198 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.856627 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.999616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:09.008252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-170584b5-fbb2-4d32-b168-d58b96506d1e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1556 microversion: 2.1 time: 0.169280 Sep 01 14:06:09.014110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 526/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:08 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:09.029904 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:09.031127 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:09.039925 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:09.048640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:09.048640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:09.048640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:09.048640 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:09.049324 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:09.126695 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f9128e29-55c5-4042-9cc5-2c28098d7833 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101068 Sep 01 14:06:09.127310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 535/1061] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 14:06:09 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:10.257508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f16bac3-e24e-4f15-9bcb-33094a730482", "tag": "96aef23f-1f83-4a28-9f70-13064947e629"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:10.276065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.277267 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.278169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.302456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] Creating event network-changed:96aef23f-1f83-4a28-9f70-13064947e629 for instance 4f16bac3-e24e-4f15-9bcb-33094a730482 on hv-cinder-83976 Sep 01 14:06:10.308606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-f5626ffa-c019-4939-9d11-394d3fc870aa req-74908c7d-81a7-4191-90b4-3a5a75f26ccc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059806 Sep 01 14:06:10.310425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 527/1062] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:22.615745 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=36 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:22.801932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-027bbbde-f932-4edc-a121-5f95ebdb0dcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Action: 'create', calling method: .version_select at 0x7f980ecdc310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1709651354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBek6EaRyZRAloEDJj+3PhZ7Rztf6WkNIAGdUOxGz0THX6J2Yxj75jAJ6e4nIY0S+W8JFSOmrWKdRjopm9iq//bcPKAKg5yYsFQZFi/3t8UjLsnd6ntDm/vZlVfjqGUG4w=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:22.818392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-027bbbde-f932-4edc-a121-5f95ebdb0dcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for project 156a972a658b46aaae3150b12dae797a. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:22.822386 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-027bbbde-f932-4edc-a121-5f95ebdb0dcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for user 384fe3ef86de41fc939e1a3cbbc6fe13 and project 156a972a658b46aaae3150b12dae797a. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:22.915329 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-027bbbde-f932-4edc-a121-5f95ebdb0dcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.300897 Sep 01 14:06:22.915900 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 536/1063] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:06:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:42.457252 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=5 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.457984 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=60 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.462523 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-316312134", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709651354", "security_groups": [{"name": "tempest-secgroup-smoke-1041808476"}], "block_device_mapping_v2": [{"uuid": "39b69828-e77b-4f40-9cfb-1543b405ba63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1512bff2-5cfc-490f-97bf-f31519dd5a25"}]}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:42.583855 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.network.neutron [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] validate_networks() for [('1512bff2-5cfc-490f-97bf-f31519dd5a25', None, None, None, None, None)] {{(pid=127708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:42.993827 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:42.994244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image limits 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:42.994709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:42.995110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image pref 0:0:0 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:42.995575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.virt.hardware [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:43.004762 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.005244 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.005793 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.006521 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.006966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.007403 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.024910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:43.029646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.quota [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for user 384fe3ef86de41fc939e1a3cbbc6fe13 and project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:43.089584 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Going to run 1 instances... {{(pid=127708) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:43.091861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39b69828-e77b-4f40-9cfb-1543b405ba63',volume_size=None,volume_type=None)] {{(pid=127708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:43.671091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b33e227b-0640-44ad-9a57-8205e93b1bcc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.215384 Sep 01 14:06:43.671774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 528/1064] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:06:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:06:43.680333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:06:43.681233 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Thu Sep 1 14:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c (ip 10.222.0.50) !!! Sep 01 14:06:43.682148 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:43.683316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:43.687383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-14771db1-a7ae-4b05-b12b-9e00877b9bdd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:43.688004 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-14771db1-a7ae-4b05-b12b-9e00877b9bdd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:43.756849 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-14771db1-a7ae-4b05-b12b-9e00877b9bdd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.764805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-14771db1-a7ae-4b05-b12b-9e00877b9bdd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1094 microversion: 2.1 time: 0.086021 Sep 01 14:06:43.765638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 537/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:43 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:44.785692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9786bc76-493a-41ed-a120-d3ecfce30277 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:44.786366 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9786bc76-493a-41ed-a120-d3ecfce30277 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:44.850050 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-9786bc76-493a-41ed-a120-d3ecfce30277 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:44.857651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9786bc76-493a-41ed-a120-d3ecfce30277 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1094 microversion: 2.1 time: 0.075915 Sep 01 14:06:44.858211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 529/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:44 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:45.878934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:45.879586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:45.886525 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.887012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.887552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.888273 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.888751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.889680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.957768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:45.966473 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-49696a82-7181-43fe-81db-058749796c0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1192 microversion: 2.1 time: 0.091640 Sep 01 14:06:45.967047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 538/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:45 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:46.992367 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:46.993518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:47.005093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.005956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.007661 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.007905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.008709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.009480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.102744 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:47.111987 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-90c869cf-1a03-42c2-9f48-0dd5a859f0de tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1210 microversion: 2.1 time: 0.127264 Sep 01 14:06:47.112936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 530/1068] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:46 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:48.133180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:48.134192 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:48.142572 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.143070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.143540 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.144276 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.144736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.145158 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.300275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:48.301105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:48.308966 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.309474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.309971 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.310886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.311448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.311838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.323538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.339001 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-806260f4-4e33-43de-a510-613cf65c1159 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.210077 Sep 01 14:06:48.359350 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 539/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:48.360626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-aa31a9ee-f171-4f0a-959c-5face7964b03 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/ips" status: 200 len: 150 microversion: 2.1 time: 0.047448 Sep 01 14:06:48.360626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 531/1070] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:48.360835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8327264a-e5fa-4a80-95fa-eeaf575a749c", "tag": "7226f044-08e5-450c-a514-11618b872f5a"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:48.360835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.360835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.360835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.373997 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] Creating event network-changed:7226f044-08e5-450c-a514-11618b872f5a for instance 8327264a-e5fa-4a80-95fa-eeaf575a749c on hv-cinder-83976 Sep 01 14:06:48.379389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-fabfcdfb-2657-4472-96ae-1c136f6f7ca7 req-7bb00869-3f6e-4c87-bc72-ce41632ac483 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037109 Sep 01 14:06:48.380970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 540/1071] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:49.366602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:49.367222 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:49.374139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.374737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.375194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.375939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.376402 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.376833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.527556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.535621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-08aaced3-6494-4cb9-88a2-0a3e5cd21899 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.173106 Sep 01 14:06:49.536183 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 532/1072] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:49 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:50.056773 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ece88e9-488e-4d3e-8e89-eec9500d6441"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:50.059190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.065527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.066020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.066452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.067146 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.067625 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.068043 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.557705 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:50.558300 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.564941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.565432 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.565860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.566556 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.567004 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.567443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.694542 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5c64a13d-b66e-47d3-bab8-c8a2bf0b248b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642857 Sep 01 14:06:50.695659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 541/1073] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:06:50 2022] POST /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:50.708841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:50.718425 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-02b469d1-67ed-4597-abe9-2c9120690d6f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.165048 Sep 01 14:06:50.719130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 533/1074] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:50 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:51.741272 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.741914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.749108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.749528 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.749966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.750690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.751123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.751586 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.895686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.904623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6813d2d3-cb5b-4f8f-b393-e821d67751c8 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.168398 Sep 01 14:06:51.905224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 542/1075] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:52.925608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:52.926202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:52.936347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.937184 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.937933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:52.939134 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.939969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.940732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.015980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:53.087910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:53.095602 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-af4962fd-a1fe-4f1a-b848-655ffc768f0b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.173889 Sep 01 14:06:53.096155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 534/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:52 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:54.117293 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:54.117926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:54.120417 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:54.125303 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:54.125784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:54.126215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.126923 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:54.127353 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:54.127795 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.262827 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.271962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2a121571-228a-417b-8234-7c2e41d8049d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.158380 Sep 01 14:06:54.272635 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 543/1077] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:54 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:55.293209 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.293830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.296240 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=8 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:55.301306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.301792 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.302246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.302980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.303427 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.303887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.443207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.451153 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-63b05f67-01b7-4a4e-b868-b7aff4cc40b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.162296 Sep 01 14:06:55.451760 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 535/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:56.472249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:56.472848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:56.479741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.480235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.480672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.481395 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.481836 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.482261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.623691 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:56.631447 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-4c8ccd68-7ea4-492b-99e3-229bf3ad5bc1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.163017 Sep 01 14:06:56.632148 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 544/1079] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:56 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:57.653682 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:57.654279 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:57.661130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:57.661618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:57.662048 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:57.662739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:57.663187 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:57.663650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:57.795138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:57.803532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-973a381b-4e27-48cb-941a-b189c86bff8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.153728 Sep 01 14:06:57.804109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 536/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:57 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:58.231804 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ece88e9-488e-4d3e-8e89-eec9500d6441"}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:58.234184 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.240777 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.241257 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.241690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.242377 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.242823 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.243252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.325901 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: POST /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments HTTP/1.1 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 74 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:06:58.327728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {"volumeAttachment": {"volumeId": "0ece88e9-488e-4d3e-8e89-eec9500d6441"}} Sep 01 14:06:58.329397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'server_id': '4f16bac3-e24e-4f15-9bcb-33094a730482', 'body': {'volumeAttachment': {'volumeId': '0ece88e9-488e-4d3e-8e89-eec9500d6441'}}} Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:06:58.330213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:58.332389 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 400 to user: Invalid volume: volume 0ece88e9-488e-4d3e-8e89-eec9500d6441 is already attached to instances: 4f16bac3-e24e-4f15-9bcb-33094a730482 {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6085c67a-44a5-4f77-8110-2a789d2956c1 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101976 Sep 01 14:06:58.334072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 545/1081] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:06:58 2022] POST /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 14:06:58.396868 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:58.397498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.404247 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.405508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.405508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.405944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.406397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.406821 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.489701 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'services' on Instance uuid 4f16bac3-e24e-4f15-9bcb-33094a730482 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:58.747878 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-bd08cd83-24b4-4065-bbd3-d0b1f19d24dd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments/0ece88e9-488e-4d3e-8e89-eec9500d6441" status: 202 len: 0 microversion: 2.1 time: 0.354874 Sep 01 14:06:58.748833 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 537/1082] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:06:58 2022] DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments/0ece88e9-488e-4d3e-8e89-eec9500d6441 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:06:58.757312 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:58.760319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.767249 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.767914 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.768363 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.769083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.769538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.769961 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.802407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b41f29e9-04d2-4a7f-b5dc-fa0b7a769eb0 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049194 Sep 01 14:06:58.802951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 546/1083] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:58 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:58.825312 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:58.826015 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.833073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.833561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.833999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.835270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.835800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.836489 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.979013 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:58.986913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1a183418-c800-45fb-a8df-f73024d931d4 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.166701 Sep 01 14:06:58.987514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 538/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:58 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:59.816776 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:59.818934 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:59.825387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.825881 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.826301 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.826991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.827457 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.827881 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.867908 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-cd9c51d2-3ff6-4ded-8da7-9cc4ac0ef2ca tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055608 Sep 01 14:06:59.868527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 547/1085] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:59 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:06:59.935972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:59.936541 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:59.943142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.943657 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.944139 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.944842 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.945291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.945705 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.979500 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:00.008662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:00.009472 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:00.015750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.016234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.016690 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.017393 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.017844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.018260 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.165210 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:00.172963 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1190dba4-6a65-4454-be74-19b1c9398b84 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.168147 Sep 01 14:07:00.173487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 548/1086] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:00 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:00.365117 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9f9ce697-f014-4928-afa5-69e0b59f32e5 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 204 len: 0 microversion: 2.1 time: 0.433018 Sep 01 14:07:00.365777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 539/1087] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:06:59 2022] DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:00.374010 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:00.374639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:00.380617 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.381095 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.381524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.382213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.382658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.383072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.522456 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:00.530621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-232eb8b1-e314-4ac9-af94-0fe01eca5767 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1681 microversion: 2.1 time: 0.160371 Sep 01 14:07:00.531279 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 549/1088] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:00 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:00.547742 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8327264a-e5fa-4a80-95fa-eeaf575a749c", "name": "network-vif-plugged", "status": "completed", "tag": "7226f044-08e5-450c-a514-11618b872f5a"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:00.557961 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.558439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.558867 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.570470 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] Creating event network-vif-plugged:7226f044-08e5-450c-a514-11618b872f5a for instance 8327264a-e5fa-4a80-95fa-eeaf575a749c on hv-cinder-83976 Sep 01 14:07:00.576025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-9ab4e3e7-6e5e-4fc7-ae39-765c7994376e req-95c49e4e-9971-402a-983d-a55564aefab0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Sep 01 14:07:00.576619 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 540/1089] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:01.193075 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:01.193632 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.200835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.201319 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.201758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.202449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.202907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.203333 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.334990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.343343 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-06d19de2-2cd4-407d-be9e-42a7ea3d9388 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.154253 Sep 01 14:07:01.343922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 550/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:01 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:01.553145 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:01.553847 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.560648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.561132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.561606 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.562310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.562761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.563179 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.699175 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.707284 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d75b405b-26a5-4754-8f6e-92ddebac3122 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1681 microversion: 2.1 time: 0.158961 Sep 01 14:07:01.707895 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 541/1091] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:01 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:02.364069 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:02.364783 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:02.371585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.372077 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.372517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.373217 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.373674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.374101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.574762 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.583108 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-754c4a1f-a89e-43e6-be33-2af5e6d46c9f tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.223147 Sep 01 14:07:02.583705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 551/1092] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:02 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:02.728346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:02.729091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:02.735295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.735805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.736232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.736919 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.737369 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.737790 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.874374 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.885643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-042c9ed6-6ee0-4f8b-9888-7ad0ab3f2a32 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1681 microversion: 2.1 time: 0.161085 Sep 01 14:07:02.886203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 542/1093] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:02 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:03.181750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f16bac3-e24e-4f15-9bcb-33094a730482", "name": "network-vif-deleted", "tag": "96aef23f-1f83-4a28-9f70-13064947e629"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:03.191263 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.191790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.192215 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.203943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] Creating event network-vif-deleted:96aef23f-1f83-4a28-9f70-13064947e629 for instance 4f16bac3-e24e-4f15-9bcb-33094a730482 on hv-cinder-83976 Sep 01 14:07:03.209365 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-eb3f2899-485d-4605-b0a6-254bbc92dd17 req-c71b3d71-9881-4c71-974d-89336d617d2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031732 Sep 01 14:07:03.209982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 552/1094] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:03.604977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:03.605692 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:03.611881 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.612612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.613114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.614065 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.614508 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.614930 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.747020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:03.754940 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-265adde5-8ecc-4579-9df3-5f1c62279ec6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1266 microversion: 2.1 time: 0.154636 Sep 01 14:07:03.755528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 543/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:03 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:03.908023 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:03.908734 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:03.915969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.916485 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.916930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.917621 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.918251 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.918677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.953789 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.954264 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.954702 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.955242 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'fault' on Instance uuid 4f16bac3-e24e-4f15-9bcb-33094a730482 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:04.000341 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.008702 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-41caf92a-c00c-4394-8584-118676fd96ac tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 200 len: 1331 microversion: 2.1 time: 0.105796 Sep 01 14:07:04.015163 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 553/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:03 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:04.774522 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:04.775072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:04.781518 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.782031 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.782421 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.783105 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.783579 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.784000 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.919578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.923094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:04.927838 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1226b2f7-81da-4c48-9d7c-0275e9fc4947 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1452 microversion: 2.1 time: 0.157250 Sep 01 14:07:04.928411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 544/1097] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:04 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:04.949521 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:04.950123 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:04.956880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.957579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.958042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.958737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.959183 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.959628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.964200 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:05.030292 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:05.030939 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:05.037866 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.038360 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.038804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.039552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.041401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.041401 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 HTTP/1.1 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:07:05.062295 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:07:05.067559 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '4f16bac3-e24e-4f15-9bcb-33094a730482'} Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:05.068577 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:07:05.070143 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:07:05.071649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:05.071649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b2605e2a-7c68-49e7-a5db-68961f74b178 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 404 len: 111 microversion: 2.1 time: 0.035877 Sep 01 14:07:05.071649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 545/1098] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:05 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:05.071649 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0408ed32-29f2-4336-bf3f-c950687e4f4e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '.version_select at 0x7f980ed31a60>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:05.100747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.108966 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ce073df8-ef01-4604-af53-6aaf811c0d95 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1452 microversion: 2.1 time: 0.164185 Sep 01 14:07:05.109534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 554/1099] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:04 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:05.142982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0408ed32-29f2-4336-bf3f-c950687e4f4e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910321730" status: 202 len: 0 microversion: 2.1 time: 0.075809 Sep 01 14:07:05.143761 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 546/1100] 10.222.0.50 () {58 vars in 1218 bytes} [Thu Sep 1 14:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910321730 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:07:05.994937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1303cfe8-c7f5-479c-a61a-690b9eadb83e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: .version_select at 0x7f980ecdcc10>, body: {"keypair": {"name": "tempest-keypair-268083262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLN6Yz7kW+eEjd3vHEDSbLHLE8OV26+h90cCwotSGsmsA4uO+V2iVF77V/4yCaWbmYTMiPBUv/ZcZAgZYpRa5h4pxw5GWHUHEN1DEfnjefe5EYVSYHguaTrpMKjAHe5hA=="}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:06.012232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1303cfe8-c7f5-479c-a61a-690b9eadb83e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:07:06.016310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-1303cfe8-c7f5-479c-a61a-690b9eadb83e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'key_pairs'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:07:06.114807 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1303cfe8-c7f5-479c-a61a-690b9eadb83e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123939 Sep 01 14:07:06.115344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 555/1101] 10.222.0.50 () {60 vars in 1159 bytes} [Thu Sep 1 14:07:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:07.498228 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8327264a-e5fa-4a80-95fa-eeaf575a749c", "tag": "7226f044-08e5-450c-a514-11618b872f5a"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:07.510684 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:07.511496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:07.511934 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:07.523506 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] Creating event network-changed:7226f044-08e5-450c-a514-11618b872f5a for instance 8327264a-e5fa-4a80-95fa-eeaf575a749c on hv-cinder-83976 Sep 01 14:07:07.530812 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-6154165c-3a09-44d1-a859-6e53a42e3622 req-5c72a636-d715-460d-992c-8fb633df05af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036467 Sep 01 14:07:07.531937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 547/1102] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:08.731437 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267207717", "imageRef": "f3df79fc-5ea3-4410-9a74-ec397f77d205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1e67750-0db8-4b1a-a617-db488366bcfd"}], "security_groups": [{"name": "tempest-securitygroup--820167665"}], "key_name": "tempest-keypair-268083262", "user_data": "}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:08.833673 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] validate_networks() for [('d1e67750-0db8-4b1a-a617-db488366bcfd', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:07:09.271722 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:07:09.274701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:07:09.274701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:07:09.274701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:07:09.274701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:07:09.282564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.282979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.283449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.284225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.284675 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.285103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.301846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:07:09.306502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Getting quotas for user 5ca20ec26ae045dbb778dfe190d474ec and project 53d9dd68ca6b4376992d408b1718c070. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:07:09.317532 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:07:09.319866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3df79fc-5ea3-4410-9a74-ec397f77d205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:07:09.472290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-89abda62-e612-4945-9d02-0949fd0d0ddf tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.745038 Sep 01 14:07:09.473392 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 556/1103] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:07:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:07:09.488860 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-baae2270-c25d-4561-9b90-c385c676c543 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:09.490475 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-baae2270-c25d-4561-9b90-c385c676c543 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:09.567561 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-baae2270-c25d-4561-9b90-c385c676c543 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:09.575132 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-baae2270-c25d-4561-9b90-c385c676c543 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1240 microversion: 2.1 time: 0.093251 Sep 01 14:07:09.575764 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 548/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:09 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:10.595482 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:10.596109 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:10.603728 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.604216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.604651 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.605411 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.605860 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.606281 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.671400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:10.682290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-edda149c-7e5a-4c9a-849b-5b4f6e3e8f27 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1244 microversion: 2.1 time: 0.091184 Sep 01 14:07:10.683054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 557/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:10 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:11.703819 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:11.704364 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:11.711713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.712203 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.712657 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.713352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.713804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.714226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.784507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:11.793066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-19e90e7e-d06b-4b5a-a07a-5614d48faad7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1292 microversion: 2.1 time: 0.093329 Sep 01 14:07:11.797098 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 549/1106] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:11 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:12.814806 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:12.815504 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:12.822822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.823318 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.823848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.824591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.825042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.825469 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.973425 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:12.981487 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a12d5a15-c36a-49f0-a54b-03966a417781 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.170983 Sep 01 14:07:12.982073 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 558/1107] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:12 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:13.644311 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de3f78d-839b-4299-847d-1e45945f1747", "tag": "26991e15-18f2-439f-960f-6ff85ead23a1"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:13.650646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:13.656174 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.656653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.657079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.671328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] Creating event network-changed:26991e15-18f2-439f-960f-6ff85ead23a1 for instance 5de3f78d-839b-4299-847d-1e45945f1747 on hv-cinder-83976 Sep 01 14:07:13.677749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-b9eff22c-d816-499a-9d2a-fac3ba1006be req-c9b9e209-2e22-4985-bbdf-f4e0afc860d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Sep 01 14:07:13.678719 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 550/1108] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:14.003570 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:14.004189 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:14.011737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.012228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.012660 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.013356 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.013804 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.014221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.148356 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:14.157926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-30a6f980-e5b8-496c-b903-8db875d2a650 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.158213 Sep 01 14:07:14.158506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 559/1109] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:13 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:15.179766 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:15.180466 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:15.187347 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.187864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.188301 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.189010 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.189467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.189893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.345463 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.356318 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d6b83520-993b-4c7e-9f97-42f02a72b9f3 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.181323 Sep 01 14:07:15.356915 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 551/1110] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:15 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:16.377538 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:16.378373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:16.380775 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:16.386166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.386645 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.387072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.387808 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.388252 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.388667 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.558906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.569786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-802d8392-5b74-4a97-b43d-471b189c82af tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.195643 Sep 01 14:07:16.571434 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 560/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:16 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:17.593659 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:17.594424 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:17.601586 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.602077 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.602527 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.603230 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.603721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.604138 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.746211 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:17.754332 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-e7668815-58d2-4b89-9d8e-6f3ab7429996 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.164789 Sep 01 14:07:17.754917 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 552/1112] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:17 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:18.724761 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de3f78d-839b-4299-847d-1e45945f1747", "name": "network-vif-plugged", "status": "completed", "tag": "26991e15-18f2-439f-960f-6ff85ead23a1"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:18.735334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.740889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.740889 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.748888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] Creating event network-vif-plugged:26991e15-18f2-439f-960f-6ff85ead23a1 for instance 5de3f78d-839b-4299-847d-1e45945f1747 on hv-cinder-83976 Sep 01 14:07:18.753979 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-abf96f64-8068-49fe-b884-4e6866ab9b58 req-688251e3-d64e-4207-95ad-7894ad364c94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033482 Sep 01 14:07:18.754593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 561/1113] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:18.774704 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:18.780371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:18.782109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.782612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.783045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.783801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.784365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.784687 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.937235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:18.950256 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1c5e3565-4a5d-407e-8672-8b3eb80d7459 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.178448 Sep 01 14:07:18.950625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 553/1114] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:18 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:19.967443 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:19.968244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=10 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:19.972967 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:19.973701 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:19.980409 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.980898 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.981344 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.982055 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.982505 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.982932 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.127707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.138814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-34a242b3-8273-42ea-b601-5110884b4a6b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1365 microversion: 2.1 time: 0.172231 Sep 01 14:07:20.139427 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 562/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:19 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:21.161270 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:21.161886 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:21.163896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:21.169539 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.170027 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.170459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.171178 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.171655 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.172088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.331531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:21.340608 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d2eb9f76-f412-415a-a76d-81a4e91f071e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1555 microversion: 2.1 time: 0.183481 Sep 01 14:07:21.341190 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 554/1116] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:21 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:21.372991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:21.373786 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:21.380571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.381092 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.381524 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.383418 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.383892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.384317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.472941 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-729d6361-7d25-4de8-87fb-509a6b2900c6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104021 Sep 01 14:07:21.473763 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 563/1117] 10.222.0.50 () {58 vars in 1275 bytes} [Thu Sep 1 14:07:21 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:22.923214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de3f78d-839b-4299-847d-1e45945f1747", "tag": "26991e15-18f2-439f-960f-6ff85ead23a1"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:22.942444 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:22.943272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:22.944348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:22.965743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] Creating event network-changed:26991e15-18f2-439f-960f-6ff85ead23a1 for instance 5de3f78d-839b-4299-847d-1e45945f1747 on hv-cinder-83976 Sep 01 14:07:22.971045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-86f2bbc9-8387-4ccf-9e71-f6bbef36de05 req-bc4f7486-9f5b-4bf6-8365-f17658f87154 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057920 Sep 01 14:07:22.971709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 555/1118] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:59.244943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=7 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:59.245638 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=42 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:59.250805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:59.251601 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:59.259452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.268874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.268874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.268874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.268874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.269330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.289086 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2cc8a83a-8c95-4661-8ca0-b282fdab1322 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/ips" status: 200 len: 150 microversion: 2.1 time: 0.045709 Sep 01 14:07:59.289681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 564/1119] 10.222.0.50 () {58 vars in 1248 bytes} [Thu Sep 1 14:07:59 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:01.528116 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=11 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:01.528864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=38 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:01.533296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60a11f35-f063-4075-a3ab-b633a638b977"}} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:01.535781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.542944 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.543548 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.543989 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.544696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.545149 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.545573 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.710626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d76aa79f-3ca1-4f6a-bb52-3cae90ab5187 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "POST /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183875 Sep 01 14:08:02.711351 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 556/1120] 10.222.0.50 () {60 vars in 1323 bytes} [Thu Sep 1 14:08:01 2022] POST /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:11.449817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:11.450399 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:11.456741 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.457224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.457656 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.458339 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.458790 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.459221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.548930 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lazy-loading 'services' on Instance uuid 5de3f78d-839b-4299-847d-1e45945f1747 {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:11.848653 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-de59121b-215e-48b8-9c2a-d67cf2f0cfe7 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments/60a11f35-f063-4075-a3ab-b633a638b977" status: 202 len: 0 microversion: 2.1 time: 0.403441 Sep 01 14:08:11.849241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 565/1121] 10.222.0.50 () {58 vars in 1416 bytes} [Thu Sep 1 14:08:11 2022] DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments/60a11f35-f063-4075-a3ab-b633a638b977 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:11.855937 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:11.860758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:11.863266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:11.870225 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.870796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.871235 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.871976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.872418 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.872828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.904573 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-282436cd-1f1b-4ecd-b574-6f6981b36074 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050059 Sep 01 14:08:11.905135 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 557/1122] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:11 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:12.918883 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:12.921688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:12.929666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:12.930274 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:12.930782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:12.931613 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:12.932124 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:12.932591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:12.967406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d443c70d-19d0-4b93-abab-640ddac6774e tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Sep 01 14:08:12.967406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 566/1123] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:12 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:13.977699 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.979877 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.986650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.987130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.987595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.988286 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.988986 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.989467 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.019713 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-21e8cc3b-4ca9-4f3a-b870-a4f7144f0a00 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046261 Sep 01 14:08:14.020274 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 558/1124] 10.222.0.50 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:13 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:08:14.081888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.082617 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.089682 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.090170 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.090602 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.091297 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.091817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.092240 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.119022 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:08:14.591696 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-bc3e80ea-eb30-4364-927d-e33779133c8a tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 204 len: 0 microversion: 2.1 time: 0.513421 Sep 01 14:08:14.592290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 567/1125] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:14 2022] DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:08:14.600709 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.602818 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.607887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.608397 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.608832 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.609532 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.609978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.610400 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.753158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:14.760969 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-865e4168-0249-4f3d-bd18-09a0e59799fd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1680 microversion: 2.1 time: 0.164154 Sep 01 14:08:14.761611 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 559/1126] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:14 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:15.785993 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:15.787287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:15.799012 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:15.799902 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:15.800684 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:15.801764 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:15.802402 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:15.802990 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:15.948874 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:15.956950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-44b52724-9023-4e0f-a3a8-3575638ddc48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1680 microversion: 2.1 time: 0.178185 Sep 01 14:08:15.957522 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 568/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:15 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:16.983809 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:16.985061 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:16.997623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.998507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.999293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.000498 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.001110 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.001642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.209514 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.218531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-eb826e04-7258-4d35-adb1-eb400a1b9236 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1680 microversion: 2.1 time: 0.242762 Sep 01 14:08:17.219238 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 560/1128] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:16 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:17.889676 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de3f78d-839b-4299-847d-1e45945f1747", "name": "network-vif-deleted", "tag": "26991e15-18f2-439f-960f-6ff85ead23a1"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:17.901848 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.902330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.902755 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.916041 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] Creating event network-vif-deleted:26991e15-18f2-439f-960f-6ff85ead23a1 for instance 5de3f78d-839b-4299-847d-1e45945f1747 on hv-cinder-83976 Sep 01 14:08:17.922020 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-8f47b599-c29d-469c-981a-637057c3ac1a req-d50c7f0d-d5d6-4188-a435-fee938c4ec70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Sep 01 14:08:17.926534 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 569/1129] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:18.241845 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:18.242651 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:18.250478 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.250968 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.251594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.252334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.252926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.253562 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.369395 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca20ec26ae045dbb778dfe190d474ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d9dd68ca6b4376992d408b1718c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:18.385166 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ba8fc021-1311-44c2-900f-028b64999682 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 200 len: 1325 microversion: 2.1 time: 0.146677 Sep 01 14:08:18.386817 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 561/1130] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:18 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 1325 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:19.409246 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:19.409991 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:19.417143 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:19.417631 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:19.421026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:19.421026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:19.421026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:19.421026 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:19.434254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 HTTP/1.1 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:08:19.435954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:19.437553 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '5de3f78d-839b-4299-847d-1e45945f1747'} Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:19.438432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:19.440296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:19.441949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:19.441949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5a52afb4-3cce-4b98-957d-38d20dbd5355 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 404 len: 111 microversion: 2.1 time: 0.033389 Sep 01 14:08:19.441949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 570/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:19 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:19.452491 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-474b9a96-b32d-4ba6-8fc9-d81333af7c95 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '.version_select at 0x7f980edbc940>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:19.569787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-474b9a96-b32d-4ba6-8fc9-d81333af7c95 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268083262" status: 202 len: 0 microversion: 2.1 time: 0.125502 Sep 01 14:08:19.570398 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 562/1132] 10.222.0.50 () {58 vars in 1218 bytes} [Thu Sep 1 14:08:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268083262 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:21.896680 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:21.897303 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:21.904571 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.905053 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.905479 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.906176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.906639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.907039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.922224 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 HTTP/1.1 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:08:21.923867 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.925556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '5de3f78d-839b-4299-847d-1e45945f1747'} Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:21.926604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.928316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.929947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:21.929947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-64fc2d5e-cfdc-4a0a-baed-84bbb94ac8cc tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 404 len: 111 microversion: 2.1 time: 0.032543 Sep 01 14:08:21.929947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 571/1133] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:21 2022] DELETE /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:21.938481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:21.940094 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 5de3f78d-839b-4299-847d-1e45945f1747] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:21.949940 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.950749 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.951633 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.952737 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.953592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.954348 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.979918 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 HTTP/1.1 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:08:21.983266 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.985019 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '5de3f78d-839b-4299-847d-1e45945f1747'} Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:21.985979 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. Sep 01 14:08:21.987727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:21.989643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 5de3f78d-839b-4299-847d-1e45945f1747 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:21.989643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-3daff98b-c654-4438-9a10-fee533c07709 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747" status: 404 len: 111 microversion: 2.1 time: 0.054703 Sep 01 14:08:21.989643 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 563/1134] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:21 2022] GET /compute/v2.1/servers/5de3f78d-839b-4299-847d-1e45945f1747 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:23.312657 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.313231 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.319759 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.320156 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.320591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.321911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.322366 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.322792 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.336269 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 HTTP/1.1 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:08:23.337854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.339975 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '4f16bac3-e24e-4f15-9bcb-33094a730482'} Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:23.340814 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.342368 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.344428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:23.344428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-9eef4e23-75c6-47fd-be36-3e1f0be6985c tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 404 len: 111 microversion: 2.1 time: 0.030576 Sep 01 14:08:23.344428 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 572/1135] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:23 2022] DELETE /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:23.349474 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.350237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 4f16bac3-e24e-4f15-9bcb-33094a730482] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.357146 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.357626 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.358058 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.358756 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.359201 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.359647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.374333 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 HTTP/1.1 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:08:23.375913 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.377505 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '4f16bac3-e24e-4f15-9bcb-33094a730482'} Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:23.378310 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. Sep 01 14:08:23.380186 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.381509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 4f16bac3-e24e-4f15-9bcb-33094a730482 could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:23.381509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-782ce364-b1d6-4fd8-a359-9fded13df7aa tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482" status: 404 len: 111 microversion: 2.1 time: 0.031831 Sep 01 14:08:23.381509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 564/1136] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:23 2022] GET /compute/v2.1/servers/4f16bac3-e24e-4f15-9bcb-33094a730482 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:23.387796 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.390330 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.394378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.394864 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.395296 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.396093 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.396546 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.396965 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.411113 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c HTTP/1.1 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:08:23.412754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.419064 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c'} Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:23.420120 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.421911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.423969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:23.423969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-b15419e0-352e-4d31-be8a-5ef0eb735f1b tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 404 len: 111 microversion: 2.1 time: 0.030849 Sep 01 14:08:23.423969 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 573/1137] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:23 2022] DELETE /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:23.426616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.427232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.434156 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.434641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.435069 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.435804 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.436254 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.436673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.452594 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c HTTP/1.1 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:08:23.454194 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.456180 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c'} Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:23.457157 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. Sep 01 14:08:23.458696 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:23.460122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:23.460122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b5b16ebb-9b71-44bd-83e4-aec5da9862cd tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c" status: 404 len: 111 microversion: 2.1 time: 0.032967 Sep 01 14:08:23.460122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 565/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:23 2022] GET /compute/v2.1/servers/a7cd5b0f-a20b-4e71-bf1c-39faeb038a9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:08:24.808949 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:24.809517 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:24.817034 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.817527 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.817995 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.818719 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.819172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.819668 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.844882 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e HTTP/1.1 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:08:24.846464 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.848103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '0d40ff85-321a-4ac4-90ec-bd8f003d6f6e'} Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:24.853090 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.854658 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.856234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:24.856234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-54b0a99c-0944-4289-968c-db2eb4d3ea48 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 404 len: 111 microversion: 2.1 time: 0.042867 Sep 01 14:08:24.856234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 574/1139] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:24 2022] DELETE /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:24.857158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:24.857801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] [instance: 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:24.865021 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.865507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.865940 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.866647 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.867100 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.867564 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.883335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] HTTP exception thrown: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Request method failure captured: Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e HTTP/1.1 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELuzSuwfGeby1f9ZFBkA3k75PYLv6z7uo1QwbplimersMaKstGzGOez09c5je37BRu8-nuYfutQh4GzD2cLWudToeZmU4FSaxe3RMbbS2KL4ub7meFnkfl1pw5VFWzRUZIWRpkmr2GwF2M3qZgbVt0tbiq6WfwOmbK10Ui6ZUMQE9NM Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:08:24.884991 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/53d9dd68ca6b4376992d408b1718c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/53d9dd68ca6b4376992d408b1718c070"}]}] Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 53d9dd68ca6b4376992d408b1718c070 Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2006198743 Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 5ca20ec26ae045dbb778dfe190d474ec Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-AttachVolumeNegativeTest-2006198743-project Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.886743 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '0d40ff85-321a-4ac4-90ec-bd8f003d6f6e'} Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:24.887787 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. Sep 01 14:08:24.889411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:08:24.890897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] Returning 404 to user: Instance 0d40ff85-321a-4ac4-90ec-bd8f003d6f6e could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:24.890897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ff6ad708-5472-415d-b8f4-f33f97c907b6 tempest-AttachVolumeNegativeTest-2006198743 tempest-AttachVolumeNegativeTest-2006198743-project] 10.222.0.50 "GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e" status: 404 len: 111 microversion: 2.1 time: 0.033735 Sep 01 14:08:24.890897 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 566/1140] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:24 2022] GET /compute/v2.1/servers/0d40ff85-321a-4ac4-90ec-bd8f003d6f6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:09:03.693244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:03.693834 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:03.696080 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:03.696799 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:03.702290 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.702905 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.703342 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.704261 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.704726 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.705155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.732497 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:09:04.150496 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-85c84a82-4fc9-45a8-84e2-35df4099041a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 204 len: 0 microversion: 2.1 time: 0.460972 Sep 01 14:09:04.151083 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 575/1141] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:09:03 2022] DELETE /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:09:04.159408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:04.160047 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:04.162263 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:04.163524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:04.169570 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.170296 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.170733 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.171459 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.171910 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.172328 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.316182 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.324323 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fecc904d-b8fd-4671-a759-38b9042c9e57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1576 microversion: 2.1 time: 0.168858 Sep 01 14:09:04.324876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 567/1142] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:04 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:05.346309 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:05.347003 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:05.354746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.355235 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.355703 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.356406 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.356856 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.357283 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.504234 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:05.512973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-2e736494-79d1-4138-a468-7f302827e22d tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1576 microversion: 2.1 time: 0.170981 Sep 01 14:09:05.513564 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 576/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:05 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:06.534612 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:06.535315 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:06.543286 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.543947 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.544442 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.545199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.545648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.546072 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.635815 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:06.649841 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-94c8d35e-c905-4ebd-8f11-18a99ef55bba tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1508 microversion: 2.1 time: 0.119559 Sep 01 14:09:06.650529 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 568/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:06 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1508 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:06.916440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8327264a-e5fa-4a80-95fa-eeaf575a749c", "name": "network-vif-deleted", "tag": "7226f044-08e5-450c-a514-11618b872f5a"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:06.934460 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.935049 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.940664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.952739 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] Creating event network-vif-deleted:7226f044-08e5-450c-a514-11618b872f5a for instance 8327264a-e5fa-4a80-95fa-eeaf575a749c on hv-cinder-83976 Sep 01 14:09:06.959133 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-47a4c937-e271-43cc-97ed-5defd1684d37 req-2f6fa94d-82d8-4912-9f10-7d2429cfe8dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046443 Sep 01 14:09:06.960647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 577/1145] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:07.670621 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:07.671273 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:07.679592 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.680334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.680956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.681871 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.682335 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.682769 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.761114 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.770359 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-c6f90bfb-0141-4e79-ba7c-2160b96c5a32 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1225 microversion: 2.1 time: 0.103773 Sep 01 14:09:07.770954 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 569/1146] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:07 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:08.792895 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:08.793628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:08.799965 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.800387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.800816 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.801506 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.801951 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.802366 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.837736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.838218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.838646 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.839089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lazy-loading 'fault' on Instance uuid 8327264a-e5fa-4a80-95fa-eeaf575a749c {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:09:09.039633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:09.039633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e9e71709-ad55-410a-8518-ec2df074ec8e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 200 len: 1184 microversion: 2.1 time: 0.103629 Sep 01 14:09:09.039633 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 578/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:08 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:09.913352 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:09.913978 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:09.920414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:09.920896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:09.921325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:09.922016 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:09.922465 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:09.922887 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:09.936524 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] HTTP exception thrown: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Request method failure captured: Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c HTTP/1.1 Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELxXoafhZqgb8PLWMJgtd9P0IERoG3t1g5ELmq6yPoePDBSx98lmSEomhNijhCKdxp7F3r_HoLdGjFjN4ewpFlF_okMiDuIUqmbalrzY7fssKnNZwKjq0lQDQaO8M0euZMtnwpKbn4KTlziMVnt0Azh9jh19vStEBYkX_JrRBAHBx9g Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:09:09.938161 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156a972a658b46aaae3150b12dae797a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156a972a658b46aaae3150b12dae797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}] Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-TestVolumeBootPattern-426060003 Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 384fe3ef86de41fc939e1a3cbbc6fe13 Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:09:09.939956 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '8327264a-e5fa-4a80-95fa-eeaf575a749c'} Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:09:09.940893 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:09:09.942678 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:09:09.944326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Returning 404 to user: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:09:09.944326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6f45c26a-1a29-4076-8e14-d651b83123df tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 404 len: 111 microversion: 2.1 time: 0.030851 Sep 01 14:09:09.944326 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 570/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:09 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:09:10.043207 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1291986009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709651354", "security_groups": [{"name": "tempest-secgroup-smoke-1041808476"}], "block_device_mapping_v2": [{"uuid": "39b69828-e77b-4f40-9cfb-1543b405ba63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1512bff2-5cfc-490f-97bf-f31519dd5a25"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:10.159544 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] validate_networks() for [('1512bff2-5cfc-490f-97bf-f31519dd5a25', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:10.799169 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:10.799639 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:10.800277 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:10.800666 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:10.801216 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:10.810316 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:10.810822 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:10.811259 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:10.812022 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:10.812705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:10.812896 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:10.830821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:10.835883 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for user 384fe3ef86de41fc939e1a3cbbc6fe13 and project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:10.920872 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:10.923031 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39b69828-e77b-4f40-9cfb-1543b405ba63',volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:11.420801 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-e6d1feec-7d1d-4edf-9b79-18f37419ff60 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.381459 Sep 01 14:09:11.421563 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 579/1149] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:09:11.432835 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d30d5b37-8d9c-4401-8c0d-3fa705bcdeda tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:11.433504 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d30d5b37-8d9c-4401-8c0d-3fa705bcdeda tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:11.551221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d30d5b37-8d9c-4401-8c0d-3fa705bcdeda tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:11.551221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d30d5b37-8d9c-4401-8c0d-3fa705bcdeda tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1095 microversion: 2.1 time: 0.075125 Sep 01 14:09:11.551221 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 571/1150] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:11 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:12.583062 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:12.583736 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:12.590604 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:12.591087 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:12.591552 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:12.592256 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:12.592710 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:12.593125 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:12.658614 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:12.666585 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-31fc0a12-a5d2-4e0d-a043-6fc200db332b tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1145 microversion: 2.1 time: 0.088125 Sep 01 14:09:12.680476 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 580/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:12 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:13.687224 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:13.687914 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:13.697941 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:13.698850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:13.699724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:13.701099 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:13.701953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:13.702452 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:13.965408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:13.965408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-993cd3d4-1493-429e-b3fa-da97f2b622c0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1193 microversion: 2.1 time: 0.277408 Sep 01 14:09:13.965408 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 572/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:13 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1193 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:14.986241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:14.986241 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:14.994278 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:14.994770 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:14.995647 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:14.996687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:14.997962 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:14.998677 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:15.246030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:15.285094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ea5ce967-6aa2-4950-98b9-aac934d7da25 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1279 microversion: 2.1 time: 0.304199 Sep 01 14:09:15.285771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 581/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:14 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:16.121724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ad3566-0951-41b4-903b-58024ea09545", "tag": "3e481f45-b4a8-4808-98d1-bc7916c412e4"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:16.132853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:16.133325 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:16.133751 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:16.161224 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] Creating event network-changed:3e481f45-b4a8-4808-98d1-bc7916c412e4 for instance b2ad3566-0951-41b4-903b-58024ea09545 on hv-cinder-83976 Sep 01 14:09:16.174982 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-9527e1c3-61c4-4b0f-b4f7-27cbe9cdf949 req-1e31f786-5d19-4ae0-b64d-474d99bc0deb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056046 Sep 01 14:09:16.178346 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 573/1154] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:16.307100 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:16.312880 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:16.315582 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:16.316327 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:16.316754 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:16.317648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:16.318106 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:16.319141 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:16.474516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:16.482709 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3414e43e-f91d-4ee2-a634-cdbfe3af43ae tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1279 microversion: 2.1 time: 0.179456 Sep 01 14:09:16.483273 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 582/1155] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:16 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:17.505507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:17.506202 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:17.512896 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:17.513440 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:17.513865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:17.514575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:17.515020 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:17.515464 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:17.671503 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:17.679875 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cb18fad9-1a65-4904-b9fb-5187a8db25b9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.179199 Sep 01 14:09:17.680714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 574/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:17 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:18.708348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:18.709016 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:18.716467 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.716946 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.717374 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.718067 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.718505 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.718918 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.861884 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:18.870499 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8482e395-e7d2-4072-a764-eaf134398dbd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.166308 Sep 01 14:09:18.871072 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 583/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:18 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:19.893656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:19.894285 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:19.900575 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.901073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.901519 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:19.902205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.902652 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.903066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:20.052889 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:20.067109 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0e20a0b2-a71e-4354-b21d-22f110485874 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.177102 Sep 01 14:09:20.068205 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 575/1158] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:19 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:21.088768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:21.089493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:21.092022 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:21.092685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=6 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:21.097628 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.098124 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.098555 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.099258 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.100304 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.100820 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.242310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:21.250866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7b13db9f-07f3-42bc-880e-963856c3ef91 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.166664 Sep 01 14:09:21.251488 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 584/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:21 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:22.272214 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:22.272876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:22.275526 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:22.280554 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:22.281107 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:22.281569 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:22.282272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:22.282721 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:22.283142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:22.424933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:22.433382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d3385163-6f76-42d6-be78-98e2a1a79e0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.165635 Sep 01 14:09:22.434028 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 576/1160] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:22 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:23.454317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:23.454927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:23.461560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.462101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.462536 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.463449 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.463687 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.464103 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.602921 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:23.611089 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-1d15b7da-45b7-42fb-a5bd-3fd6f3a631f2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.160628 Sep 01 14:09:23.612039 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 585/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:23 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:24.632104 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:24.632781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:24.639451 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:24.639936 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:24.640380 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:24.649675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:24.649675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:24.649675 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:24.779861 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:24.789064 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-1e31168e-f5ea-463e-84a9-243660c26862 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.160824 Sep 01 14:09:24.789856 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 577/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:24 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:25.810190 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:25.810955 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:25.817494 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.817977 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.818410 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.819107 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.819598 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.820018 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.965244 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:25.971595 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-3d5f2ba4-9fa9-4af1-9e96-79b3c5466275 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.165267 Sep 01 14:09:25.972157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 586/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:25 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:26.994057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:26.994674 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:27.001169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.001648 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.002085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:27.002775 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.003226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.003673 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:27.132688 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:27.140481 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-0a5432b3-219e-4629-bb22-acb0ba84cfdc tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.150824 Sep 01 14:09:27.141051 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 578/1164] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:26 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:28.161114 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:28.161707 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:28.168255 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:28.168907 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:28.169176 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.169863 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:28.170311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:28.170727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.303751 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:28.311906 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-a6cd1975-84cd-4bba-836d-766fe3363974 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.154733 Sep 01 14:09:28.312511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 587/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:28 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:29.333001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:29.334990 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:29.340905 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.341457 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.341789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.342480 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.342922 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.343342 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.507075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.507075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7e7b1b86-f747-4939-8fc7-065c8822fdb0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.165264 Sep 01 14:09:29.507075 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 579/1166] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:29 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:29.507705 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ad3566-0951-41b4-903b-58024ea09545", "name": "network-vif-plugged", "status": "completed", "tag": "3e481f45-b4a8-4808-98d1-bc7916c412e4"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:29.517593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.517970 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.518400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.530587 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] Creating event network-vif-plugged:3e481f45-b4a8-4808-98d1-bc7916c412e4 for instance b2ad3566-0951-41b4-903b-58024ea09545 on hv-cinder-83976 Sep 01 14:09:29.535768 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-53fb46a1-aebe-4d38-9e23-97088a79c3da req-9be08719-7874-46c9-835e-efda940cd62c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036554 Sep 01 14:09:29.536288 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 588/1167] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:30.516210 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:30.516801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:30.523884 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.524372 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.524807 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:30.525509 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.525958 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.526377 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:30.665212 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:30.673169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4b2510a5-82a8-4b0e-bc8c-9efca2d5a5bd tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.160863 Sep 01 14:09:30.673732 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 580/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:30 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:31.695022 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:31.695740 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:31.701931 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.702405 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.702841 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.703566 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.704011 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.704444 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.855588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.864166 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-6b0a10f8-9ca2-4b99-978f-2199b1352f1c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1267 microversion: 2.1 time: 0.173728 Sep 01 14:09:31.864782 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 589/1169] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:31 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:32.884461 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:32.885066 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:32.891635 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.892199 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.892538 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.893226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.893672 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.894090 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.029727 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:33.038023 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-ee630708-ff45-4f72-bcf5-73fd951685ca tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1453 microversion: 2.1 time: 0.157464 Sep 01 14:09:33.038578 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 581/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:32 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:33.057998 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:33.058609 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:33.065124 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.065611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.066042 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.066733 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.067180 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.067664 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.202091 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:33.210926 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f4208c98-d539-44d5-84fa-8bbaad589932 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1453 microversion: 2.1 time: 0.156658 Sep 01 14:09:33.211531 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 590/1171] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:33 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:35.519443 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ad3566-0951-41b4-903b-58024ea09545", "tag": "3e481f45-b4a8-4808-98d1-bc7916c412e4"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:35.529963 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:35.530435 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:35.530865 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:35.543232 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] Creating event network-changed:3e481f45-b4a8-4808-98d1-bc7916c412e4 for instance b2ad3566-0951-41b4-903b-58024ea09545 on hv-cinder-83976 Sep 01 14:09:35.552493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-cac5d7ef-dd16-409e-b34b-e550882571a7 req-5f1455d8-966b-4c20-b278-c4b90c3403fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Sep 01 14:09:35.552493 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 582/1172] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:30.117787 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:30.118551 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:30.119337 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:11:30.119511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Thu Sep 1 14:11:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Sep 01 14:11:30.130674 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-195825683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709651354", "security_groups": [{"name": "tempest-secgroup-smoke-1041808476"}], "block_device_mapping_v2": [{"uuid": "279fa1ee-4fee-4479-bc9b-b72e8cb968d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1512bff2-5cfc-490f-97bf-f31519dd5a25"}]}} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:30.251672 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.network.neutron [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] validate_networks() for [('1512bff2-5cfc-490f-97bf-f31519dd5a25', None, None, None, None, None)] {{(pid=127709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:11:30.646147 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:11:30.646771 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image limits 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:11:30.647243 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Flavor pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:11:30.647685 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Image pref 0:0:0 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:11:30.648094 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.virt.hardware [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:11:30.657121 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.658157 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.658620 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.659335 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.659808 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.660232 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.677843 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:30.682338 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.quota [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Getting quotas for user 384fe3ef86de41fc939e1a3cbbc6fe13 and project 156a972a658b46aaae3150b12dae797a. Resources: {'cores', 'instances', 'ram'} {{(pid=127709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:30.748442 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Going to run 1 instances... {{(pid=127709) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:11:30.750805 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='279fa1ee-4fee-4479-bc9b-b72e8cb968d6',volume_size=None,volume_type=None)] {{(pid=127709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:11:31.286648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d9dadbdc-e677-47dd-bb57-afdaf8b52421 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.170544 Sep 01 14:11:31.291670 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 591/1173] 10.222.0.50 () {60 vars in 1147 bytes} [Thu Sep 1 14:11:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:11:31.298774 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3af48f5c-876d-48b9-8222-4e06f7ca6186] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 14:11:31.299748 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=34 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:31.300781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=78 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:31.302076 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:11:31.302291 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Thu Sep 1 14:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b (ip 10.222.0.50) !!! Sep 01 14:11:31.304439 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:11:31.304641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Thu Sep 1 14:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b (ip 10.222.0.50) !!! Sep 01 14:11:31.312972 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-d337f1cf-c62f-45cd-a1ea-584f8a1fa5cf tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:31.314382 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-d337f1cf-c62f-45cd-a1ea-584f8a1fa5cf tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:31.391237 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-d337f1cf-c62f-45cd-a1ea-584f8a1fa5cf tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:31.398781 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-d337f1cf-c62f-45cd-a1ea-584f8a1fa5cf tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1094 microversion: 2.1 time: 0.103281 Sep 01 14:11:31.399413 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 583/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:31 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:32.420372 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-67fdd4d2-472f-4929-91df-aadfbc85d1d9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:32.421186 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-67fdd4d2-472f-4929-91df-aadfbc85d1d9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:32.479221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-67fdd4d2-472f-4929-91df-aadfbc85d1d9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:32.487334 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-67fdd4d2-472f-4929-91df-aadfbc85d1d9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1094 microversion: 2.1 time: 0.071610 Sep 01 14:11:32.487940 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 592/1175] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:32 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:33.517088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:33.517088 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:33.518373 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.518862 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.519293 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.520025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.520472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.520933 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.527395 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO oslo.messaging._drivers.impl_rabbit [-] [3af48f5c-876d-48b9-8222-4e06f7ca6186] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51074. Sep 01 14:11:33.587616 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:33.595676 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-fcce0663-e49a-44df-963f-e45d2cf63336 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1192 microversion: 2.1 time: 0.091072 Sep 01 14:11:33.596264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 584/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:33 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:34.619070 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:34.619720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:34.626767 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.627254 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.627711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.628404 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.628854 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.629317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.691912 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:34.699996 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-f5df0409-d9b9-42df-91fd-96692b4c87f9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1210 microversion: 2.1 time: 0.084741 Sep 01 14:11:34.704359 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 593/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:34 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:35.720700 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:35.721306 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:35.727664 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.728141 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.728567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.729246 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.729695 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.730111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.951017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:35.959001 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-cf31f1fd-eed1-4d9e-96c3-27102eac4847 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1278 microversion: 2.1 time: 0.242074 Sep 01 14:11:35.959614 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 585/1178] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:35 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:36.284315 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eacfd22e-d30f-4641-9d5c-ab2194d5074b", "tag": "fd5978a9-1659-4984-9356-ac797814cb24"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:36.294074 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.294549 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.294976 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.307030 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] Creating event network-changed:fd5978a9-1659-4984-9356-ac797814cb24 for instance eacfd22e-d30f-4641-9d5c-ab2194d5074b on hv-cinder-83976 Sep 01 14:11:36.312172 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-26d43591-0e5c-4bdc-9ed4-24e4315376a3 req-ffecb559-5918-4b42-a005-fd960f3e4250 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157640 Sep 01 14:11:36.312811 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 594/1179] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:36.981387 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.982089 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.989003 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.989567 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.990073 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.990864 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.991477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.991976 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.166595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:37.176017 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-763d1953-8ce3-4166-86bf-6687fe62a3f1 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.198847 Sep 01 14:11:37.176646 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 586/1180] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:36 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:38.198746 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:38.199401 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:38.207225 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.207737 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.208164 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.208866 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.209310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.209785 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.346515 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:38.354588 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-381d5a02-dbd5-4207-b1d4-a6df00ab0616 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.160567 Sep 01 14:11:38.355171 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 595/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:38 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:39.375142 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:39.375773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:39.382169 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.382650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.383079 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.383800 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.384314 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.384738 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.518618 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:39.526507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-705f8175-2872-4359-933c-fd297321cb1e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.155273 Sep 01 14:11:39.527082 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 587/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:39 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:40.547516 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:40.548688 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:40.555112 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.555618 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.556045 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.556758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.557211 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.557622 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.667581 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=2 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:40.700440 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:40.708681 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ff537d7e-bdde-42a9-b082-a9ac5ebf9022 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.165017 Sep 01 14:11:40.709250 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 596/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:40 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:41.730371 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:41.730977 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:41.733515 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell0:SELECT=2 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:41.738993 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.748942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.748942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.748942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.748942 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.749435 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.877573 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:41.885207 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-efa8ac6c-22ef-4ac9-8788-a3130c53b8b7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.158809 Sep 01 14:11:41.885777 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 588/1184] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:41 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:42.905490 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:42.906116 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:42.908398 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell0:SELECT=8 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:42.913148 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.913623 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.914050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.914780 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.915221 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.915662 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.048381 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:43.056289 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c175db2b-62a9-404e-bbe9-2671b541bf57 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.154583 Sep 01 14:11:43.056888 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 597/1185] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:42 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:44.077409 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:44.078122 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:44.085488 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.086025 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.095155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.095155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.095155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.095155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.222078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:44.229828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-71e1ce6a-a2a0-499c-8c98-afa993c075a6 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.156332 Sep 01 14:11:44.230391 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 589/1186] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:44 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:45.249846 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:45.250471 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:45.260459 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.260947 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.261378 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.262081 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.262541 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.262954 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.411196 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:45.419317 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-fe8eed89-ca5d-4a73-a843-52df0dc1317a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.173216 Sep 01 14:11:45.419937 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 598/1187] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:45 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:45.972805 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eacfd22e-d30f-4641-9d5c-ab2194d5074b", "name": "network-vif-plugged", "status": "completed", "tag": "fd5978a9-1659-4984-9356-ac797814cb24"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:45.982642 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.983115 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.983576 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.996045 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] Creating event network-vif-plugged:fd5978a9-1659-4984-9356-ac797814cb24 for instance eacfd22e-d30f-4641-9d5c-ab2194d5074b on hv-cinder-83976 Sep 01 14:11:46.004542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-60fe186b-f243-4984-af87-c2a8be5a588d req-151bd73a-855e-4493-a08e-88085421c029 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094197 Sep 01 14:11:46.004542 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 590/1188] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:46.440213 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:46.441616 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:46.449911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.450397 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.450821 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.451558 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.452996 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.453432 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.595830 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:46.608574 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-01caa74e-65ad-47b3-b563-85052b9f6f2a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.167519 Sep 01 14:11:46.608574 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 599/1189] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:46 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:47.625453 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:47.626130 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:47.632365 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:47.632843 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:47.633275 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:47.633967 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:47.634429 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:47.634853 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:47.765507 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:47.773650 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-5bb646b3-c43e-471a-a873-c7f44d5428e2 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1266 microversion: 2.1 time: 0.152931 Sep 01 14:11:47.774208 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 591/1190] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:47 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:48.795101 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:48.795720 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:48.802784 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.803266 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.803802 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.804501 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.804943 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.805395 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.935206 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:48.943000 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-d723c86d-a3a3-4d7d-a46e-1eaaa656a03c tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1452 microversion: 2.1 time: 0.151750 Sep 01 14:11:48.943648 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 600/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:48 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:48.962517 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:48.963155 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:48.970167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.970638 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.971062 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.971849 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.972294 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.972710 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:49.104997 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:49.113724 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-4bb79d79-1069-41fc-af7e-e2f707d94d0a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1452 microversion: 2.1 time: 0.155005 Sep 01 14:11:49.114407 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 592/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:48 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:51.530218 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eacfd22e-d30f-4641-9d5c-ab2194d5074b", "tag": "fd5978a9-1659-4984-9356-ac797814cb24"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:51.540230 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:51.540711 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:51.541142 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:51.553727 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] Creating event network-changed:fd5978a9-1659-4984-9356-ac797814cb24 for instance eacfd22e-d30f-4641-9d5c-ab2194d5074b on hv-cinder-83976 Sep 01 14:11:51.558837 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-cfebafc7-c846-4720-be95-51a5d3b41676 req-880add15-21e0-4d96-9ab4-512c65db2075 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104399 Sep 01 14:11:51.559489 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 601/1193] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:31.259552 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.260127 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR oslo.messaging._drivers.impl_rabbit [-] [120325fe-cfc6-4383-9b7a-a135b1b9e358] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 14:13:31.260511 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.260611 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.261493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG dbcounter [-] [127709] Writing DB stats nova_cell1:SELECT=48 {{(pid=127709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.262789 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_api:SELECT=22 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.263572 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG dbcounter [-] [127708] Writing DB stats nova_cell1:SELECT=50 {{(pid=127708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.267050 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eacfd22e-d30f-4641-9d5c-ab2194d5074b", "tag": "fd5978a9-1659-4984-9356-ac797814cb24"}]} {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:31.271131 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.271657 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.272091 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.272794 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.273248 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.273666 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.277155 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.278423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.278423 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.289835 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.compute.server_external_events [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] Creating event network-changed:fd5978a9-1659-4984-9356-ac797814cb24 for instance eacfd22e-d30f-4641-9d5c-ab2194d5074b on hv-cinder-83976 Sep 01 14:13:31.296502 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [req-08eb408c-f948-4e06-92fb-cc4b695c8d0f req-61e80dab-1bd9-4c51-9a23-bcb44a722696 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038387 Sep 01 14:13:31.301407 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 602/1194] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:31.302522 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Going to try to terminate instance {{(pid=127708) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:13:31.627411 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-9ba67d5a-e1a6-44b9-99e5-5572a676b0d7 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 204 len: 0 microversion: 2.1 time: 0.372334 Sep 01 14:13:31.627953 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 593/1195] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:31 2022] DELETE /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:13:31.636665 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.637495 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.644973 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.645590 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.646436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.646890 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.647436 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.647927 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.791285 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.799760 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-7c03959c-c8ff-44ed-918f-37c0217566b0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1576 microversion: 2.1 time: 0.167317 Sep 01 14:13:31.800373 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 603/1196] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:31 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:32.821980 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:32.822683 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:32.829938 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.830416 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.830850 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.831583 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.832035 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.832456 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:33.032835 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:33.041078 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-b228ac0c-ba91-4e08-849e-3e26b5b63a10 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1576 microversion: 2.1 time: 0.223378 Sep 01 14:13:33.041653 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 594/1197] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:32 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:34.061452 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:34.062045 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:34.069939 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:34.070686 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.070817 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.071533 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:34.071984 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.072400 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.078346 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO oslo.messaging._drivers.impl_rabbit [-] [120325fe-cfc6-4383-9b7a-a135b1b9e358] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51160. Sep 01 14:13:34.211191 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.219911 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-ecc5928b-ae1e-4a3f-ba43-6be590e94d07 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1458 microversion: 2.1 time: 0.162413 Sep 01 14:13:34.220484 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 604/1198] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:34 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:34.266057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eacfd22e-d30f-4641-9d5c-ab2194d5074b", "name": "network-vif-deleted", "tag": "fd5978a9-1659-4984-9356-ac797814cb24"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:34.275585 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:34.276992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.276992 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.290623 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] Creating event network-vif-deleted:fd5978a9-1659-4984-9356-ac797814cb24 for instance eacfd22e-d30f-4641-9d5c-ab2194d5074b on hv-cinder-83976 Sep 01 14:13:34.297185 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-94692e57-8b03-45bf-ab90-eacaa9454a18 req-e8650175-a923-4dcc-81e6-6cbac2e6b0aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035500 Sep 01 14:13:34.297801 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 595/1199] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:35.242287 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:35.242844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:35.249228 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.249708 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.250138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.250825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.251311 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.251758 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.282892 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.283383 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.283825 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.284273 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.objects.instance [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lazy-loading 'fault' on Instance uuid eacfd22e-d30f-4641-9d5c-ab2194d5074b {{(pid=127709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:35.326268 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.334037 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-c6a83bd8-43f5-4607-a697-2f33e181eefe tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 200 len: 1230 microversion: 2.1 time: 0.095628 Sep 01 14:13:35.345706 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 605/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:35 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:36.358448 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:36.359057 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: eacfd22e-d30f-4641-9d5c-ab2194d5074b] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:36.365739 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.366220 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.366641 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.367322 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.367796 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.368215 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.381892 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] HTTP exception thrown: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Request method failure captured: Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b HTTP/1.1 Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELxXoafhZqgb8PLWMJgtd9P0IERoG3t1g5ELmq6yPoePDBSx98lmSEomhNijhCKdxp7F3r_HoLdGjFjN4ewpFlF_okMiDuIUqmbalrzY7fssKnNZwKjq0lQDQaO8M0euZMtnwpKbn4KTlziMVnt0Azh9jh19vStEBYkX_JrRBAHBx9g Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:13:36.383528 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156a972a658b46aaae3150b12dae797a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156a972a658b46aaae3150b12dae797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}] Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 384fe3ef86de41fc939e1a3cbbc6fe13 Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. Sep 01 14:13:36.385136 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': 'eacfd22e-d30f-4641-9d5c-ab2194d5074b'} Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:36.386095 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. Sep 01 14:13:36.387885 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:36.389472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Returning 404 to user: Instance eacfd22e-d30f-4641-9d5c-ab2194d5074b could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:36.389472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-dfa721c3-5737-49d7-a187-29f5ab8990e9 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b" status: 404 len: 111 microversion: 2.1 time: 0.033510 Sep 01 14:13:36.389472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 596/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:36 2022] GET /compute/v2.1/servers/eacfd22e-d30f-4641-9d5c-ab2194d5074b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:39.821554 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:39.822054 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:39.824495 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ad3566-0951-41b4-903b-58024ea09545", "tag": "3e481f45-b4a8-4808-98d1-bc7916c412e4"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:39.828715 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.829420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.829859 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.830556 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.830999 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.831493 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.845973 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.846925 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.847908 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.860348 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Going to try to terminate instance {{(pid=127709) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:13:39.861117 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] Creating event network-changed:3e481f45-b4a8-4808-98d1-bc7916c412e4 for instance b2ad3566-0951-41b4-903b-58024ea09545 on hv-cinder-83976 Sep 01 14:13:39.866830 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-ee8d67c8-6efc-4e97-a172-82584de4d105 req-38fb1eb4-c6e0-4505-9ef7-7b84a3296b92 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046697 Sep 01 14:13:39.867731 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 597/1202] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:40.314038 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8700c0b8-7a41-4a64-acfd-fc6065c03f42 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 204 len: 0 microversion: 2.1 time: 0.496254 Sep 01 14:13:40.314715 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 606/1203] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:39 2022] DELETE /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:13:40.324172 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:40.325272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:40.332415 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:40.332891 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:40.333331 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.334147 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:40.334610 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:40.335038 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.499477 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.507999 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-7f4a6048-fd59-4ab4-87f1-547c5aa90d5e tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1577 microversion: 2.1 time: 0.188274 Sep 01 14:13:40.508589 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 598/1204] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:40 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:41.531431 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:41.532134 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:41.538511 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.538994 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.539450 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.540138 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.540593 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.541015 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.674698 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:41.682562 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-8c4c0f30-84d5-44ab-9651-d5b97d5d2e18 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1577 microversion: 2.1 time: 0.156080 Sep 01 14:13:41.683150 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 607/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:41 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:42.651714 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ad3566-0951-41b4-903b-58024ea09545", "name": "network-vif-deleted", "tag": "3e481f45-b4a8-4808-98d1-bc7916c412e4"}]} {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:42.662385 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:42.662852 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:42.663272 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.675625 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.compute.server_external_events [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] Creating event network-vif-deleted:3e481f45-b4a8-4808-98d1-bc7916c412e4 for instance b2ad3566-0951-41b4-903b-58024ea09545 on hv-cinder-83976 Sep 01 14:13:42.680758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [req-f1bbf4e0-8e34-4b1c-aaa7-6c82c5fc1ca4 req-d4e0d5f2-4543-4db5-8e47-e248e8c6238e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032908 Sep 01 14:13:42.681436 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 599/1206] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:42.704047 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:42.705968 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:42.711195 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:42.711732 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:42.712162 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.712844 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:42.713286 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:42.713699 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.776033 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.policy [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127709) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.784387 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-5341a915-b9d4-44dc-938e-9b5a30472aac tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1391 microversion: 2.1 time: 0.084385 Sep 01 14:13:42.784950 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 608/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:42 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1391 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:43.805540 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:43.806226 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:43.813566 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.814044 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.814472 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.815158 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.815632 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.816052 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.847690 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.848167 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.848595 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.849034 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.objects.instance [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lazy-loading 'fault' on Instance uuid b2ad3566-0951-41b4-903b-58024ea09545 {{(pid=127708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:43.891876 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.policy [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384fe3ef86de41fc939e1a3cbbc6fe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156a972a658b46aaae3150b12dae797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127708) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:43.902111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-edbcc1e5-5ac6-4dc0-b31e-493f483d6a6a tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 200 len: 1231 microversion: 2.1 time: 0.099498 Sep 01 14:13:43.902111 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 600/1208] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:43 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:44.921508 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:44.922117 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: b2ad3566-0951-41b4-903b-58024ea09545] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:44.928659 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.929143 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.929579 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.930302 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.930756 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.931181 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.944953 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] HTTP exception thrown: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Request method failure captured: Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 HTTP/1.1 Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELxXoafhZqgb8PLWMJgtd9P0IERoG3t1g5ELmq6yPoePDBSx98lmSEomhNijhCKdxp7F3r_HoLdGjFjN4ewpFlF_okMiDuIUqmbalrzY7fssKnNZwKjq0lQDQaO8M0euZMtnwpKbn4KTlziMVnt0Azh9jh19vStEBYkX_JrRBAHBx9g Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:13:44.946692 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156a972a658b46aaae3150b12dae797a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156a972a658b46aaae3150b12dae797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}] Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 384fe3ef86de41fc939e1a3cbbc6fe13 Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. Sep 01 14:13:44.948560 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': 'b2ad3566-0951-41b4-903b-58024ea09545'} Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:44.949390 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. Sep 01 14:13:44.950750 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:44.952098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Returning 404 to user: Instance b2ad3566-0951-41b4-903b-58024ea09545 could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:44.952098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-34d050b3-7d86-44bc-86e9-da50659a6bc0 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545" status: 404 len: 111 microversion: 2.1 time: 0.031119 Sep 01 14:13:44.952098 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 609/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:44 2022] GET /compute/v2.1/servers/b2ad3566-0951-41b4-903b-58024ea09545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:45.453531 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:45.454085 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.compute.api [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127708) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:45.460828 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.461334 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.461773 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.462496 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.462949 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.463433 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG oslo_concurrency.lockutils [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.477395 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.wsgi [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] HTTP exception thrown: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Request method failure captured: Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: request: DELETE /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c HTTP/1.1 Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept: application/json Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Accept-Encoding: identity Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Connection: close Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Length: 0 Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Content-Type: application/json Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Host: 10.222.0.50 Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: Openstack-System-Scope: None Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Auth-Token: gAAAAABjELxXoafhZqgb8PLWMJgtd9P0IERoG3t1g5ELmq6yPoePDBSx98lmSEomhNijhCKdxp7F3r_HoLdGjFjN4ewpFlF_okMiDuIUqmbalrzY7fssKnNZwKjq0lQDQaO8M0euZMtnwpKbn4KTlziMVnt0Azh9jh19vStEBYkX_JrRBAHBx9g Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Id: None Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Domain-Name: None Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Identity-Status: Confirmed Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Is-Admin-Project: True Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Id: default Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Domain-Name: Default Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Project-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Role: reader,member Sep 01 14:13:45.479093 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Roles: reader,member Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156a972a658b46aaae3150b12dae797a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156a972a658b46aaae3150b12dae797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}] Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-Tenant-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Id: default Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Domain-Name: Default Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Id: 384fe3ef86de41fc939e1a3cbbc6fe13 Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: X-User-Name: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: method: > Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: exception: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.480926 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: action_args: {'id': '8327264a-e5fa-4a80-95fa-eeaf575a749c'} Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:45.482264 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.483758 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.485124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Returning 404 to user: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. {{(pid=127708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:45.485124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-47411a7d-0715-4fe5-b41c-bfc74d2a3783 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 404 len: 111 microversion: 2.1 time: 0.031929 Sep 01 14:13:45.485124 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 601/1210] 10.222.0.50 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:45 2022] DELETE /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:45.489974 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '>' {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:45.490591 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.compute.api [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] [instance: 8327264a-e5fa-4a80-95fa-eeaf575a749c] Fetching instance by UUID {{(pid=127709) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:45.496831 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.497310 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.498289 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.498982 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Acquiring lock "faee2cfd-b53c-4fee-84f6-475fe826578e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.499455 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.499877 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG oslo_concurrency.lockutils [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Lock "faee2cfd-b53c-4fee-84f6-475fe826578e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.513420 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.wsgi [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] HTTP exception thrown: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Request method failure captured: Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: request: GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c HTTP/1.1 Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept: application/json Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Accept-Encoding: identity Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Connection: close Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Length: 0 Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Content-Type: application/json Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Host: 10.222.0.50 Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: Openstack-System-Scope: None Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Auth-Token: gAAAAABjELxXoafhZqgb8PLWMJgtd9P0IERoG3t1g5ELmq6yPoePDBSx98lmSEomhNijhCKdxp7F3r_HoLdGjFjN4ewpFlF_okMiDuIUqmbalrzY7fssKnNZwKjq0lQDQaO8M0euZMtnwpKbn4KTlziMVnt0Azh9jh19vStEBYkX_JrRBAHBx9g Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Id: None Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Domain-Name: None Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Identity-Status: Confirmed Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Is-Admin-Project: True Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Id: default Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Domain-Name: Default Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Project-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Role: reader,member Sep 01 14:13:45.514747 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Roles: reader,member Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_156a972a658b46aaae3150b12dae797a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/156a972a658b46aaae3150b12dae797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/156a972a658b46aaae3150b12dae797a"}]}] Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Id: 156a972a658b46aaae3150b12dae797a Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-Tenant-Name: tempest-TestVolumeBootPattern-426060003 Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Id: default Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Domain-Name: Default Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Id: 384fe3ef86de41fc939e1a3cbbc6fe13 Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: X-User-Name: tempest-TestVolumeBootPattern-426060003-project Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: method: > Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: exception: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.516573 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: action_args: {'id': '8327264a-e5fa-4a80-95fa-eeaf575a749c'} Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: {{(pid=127709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:45.517446 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. Sep 01 14:13:45.518922 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: ERROR nova.api.openstack.wsgi Sep 01 14:13:45.520298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: DEBUG nova.api.openstack.wsgi [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Returning 404 to user: Instance 8327264a-e5fa-4a80-95fa-eeaf575a749c could not be found. {{(pid=127709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:45.520298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: INFO nova.api.openstack.requestlog [None req-42d2db3e-2e74-4190-83d5-ef94006bd231 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c" status: 404 len: 111 microversion: 2.1 time: 0.030304 Sep 01 14:13:45.520298 dv-cinder-839768-5-iscsi devstack@n-api.service[127709]: [pid: 127709|app: 0|req: 610/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:45 2022] GET /compute/v2.1/servers/8327264a-e5fa-4a80-95fa-eeaf575a749c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:47.087414 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: DEBUG nova.api.openstack.wsgi [None req-6c459aa9-4c55-40c8-942c-10adfbcab201 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] Calling method '.version_select at 0x7f980ec41e50>' {{(pid=127708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:47.229656 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: INFO nova.api.openstack.requestlog [None req-6c459aa9-4c55-40c8-942c-10adfbcab201 tempest-TestVolumeBootPattern-426060003 tempest-TestVolumeBootPattern-426060003-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1709651354" status: 202 len: 0 microversion: 2.1 time: 0.149657 Sep 01 14:13:47.230557 dv-cinder-839768-5-iscsi devstack@n-api.service[127708]: [pid: 127708|app: 0|req: 602/1212] 10.222.0.50 () {58 vars in 1263 bytes} [Thu Sep 1 14:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1709651354 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)